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I .  Overview 


SAFARI  is  a  linguistically  oriented  text-processing  system  intended 
for  use  by  individual  research  analysts  in  the  development  of  their  own 
personal  files.  It  contains  a  collection  of  programs  designed  to  analyze 
English  sentences  so  that  the  information  they  contain  can  be  identified, 
stored,  and  subsequently  retrieved.  Declarative  sentences,  when  processed, 
accumulate  to  form  the  data  base;  interrogative  sentences  serve  to  query 
that  data  base. 

The  procedure  may  be  thought  of  as  having  four  stages,  represented 
schematically  on  the  following  page.  The  first  is  a  morphological 
analysis  of  each  word  of  the  input  sentence,  accompanied  by  a  lexical 
look-up.  This  stage  is  followed  by  a  context-free  parsing  of  the  sen¬ 
tence.  The  third  stage  involves  the  application  of  transformations 
which,  variously,  reject  inappropriate  parsings,  derive  the  base  struc¬ 
ture,  and  standardize  the  result  in  a  canonical  tree  format.  Finally, 
the  canonical  representation  either  is  stored  in  the  data  base  (for 
declarative  sentences)  or  is  used  to  search  for  related  structures  (for 
interrogative  sentences) . 

The  first  three  stages  comprise  the  analysis  procedure.  For  each, 
certain  linguistics  inputs  are  necessary.  Stage  one  requires  a  lexicon 
and  rules  to  govern  the  morphological  analyzer.  The  parser  needs  a  set 
of  phrase-structure  rules  as  its  grammar.  Transformational  rules  must 
be  specified  for  the  last  analysis  phase.  Of  course,  the  grammaticality 
of  a  sentence  is  determined  by  and  relative  to  the  particular  sets  of 
rules  and  lexical  entries  provided.  The  programs  for  the  analysis  pro¬ 
cedure  are  written  so  that  they  are  independent  of  a  particular  set  of 
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answers 

(for  interrogative  input  sentences) 


Figure  I-A:  Schematic  diagram  of  SAFARI 
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lingiiistic  inputs.  Thus  the  system  may  be  used  to  test  different  trans¬ 
formational  grammars,  and  the  scope  of  the  lexicon  and  the  grammar  may 
be  increased  without  modifying  the  programs. 

The  programs  for  SAFARI  have  been  implemented  in  the  TREET  list¬ 
processing  system.  They  are  currently  operational  in  an  off-line  mode 
on  IBM  360  series  computers  under  OS;  a  minimum  of  175,000  bytes  of 
memory  must  be  assigned  to  the  user.  When  running  with  close  to  the 
minimum  amount  of  core,  each  of  the  four  stages  enumerated  above  runs 
in  a  separate  core  image  (TREET-360  Newsletter  #12) .  Communication 
between  these  stages  is  via  the  TREET  filing  system  (TREET-360  Newsletter 
#14);  i.e.,  the  disk  is  used  for  temporary  data  storage. 

Although  the  programs  have  been  developed  in  an  off-line  mode,  they 
were  designed  to  be  operated  as  components  of  an  on-line  system.  The 
absence  of  on-line  access  means  that  the  system,  though  internally  com¬ 
plete,  is  presently  in  an  unpolished  state.  No  attempts  have  been  made 
to  design  the  messages,  formats,  etc.  which  will  provide  an  optimal 
interface  between  the  user  and  the  system.  The  inability  to  interact 
on-line  prevents  communication  during  the  analysis  process.  The  most 
serious  consequence  of  this  restriction  is  the  inability  to  specify  a 
choice  between  interpretations  when  an  input  sentence  is  ambiguous  to 
the  grammar.  Other  interactions  would  be  required  to  allow  such  inputs 
as  additions  to  the  lexicon.  In  addition,  little  work  has  been  done  on 
the  manner  in  which  an  answer  should  be  presented. 
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II.  Stage  I:  A.  Assignment  of  Lexical  Categorizations 

The  input  to  SAFARI  is  an  English  sentence,  i.e.,  a  string  of 
words  with  the  usual  punctuation  marks;  they  appear  as  atoms  to  the 
TREET  system.  The  first  stage  of  the  analysis  procedure  deals  with 
this  string.  The  first  step  is  to  set  a  flag  on  the  basis  of  the 
absence  or  presence  of  a  question  mark;  as  will  be  seen,  reference 
is  made  to  this  flag  in  each  subsequent  stage  of  SAFARI,  to  provide 
the  appropriate  processing. 

Each  element  of  the  sentence  is  then  examined  in  reverse  order, 
and  the  effect  is  to  process  the  sentence  from  right  to  left.  We  use 
the  term  "element"  instead  of  "word"  for  two  related  reasons.  The 
syntax  of  a  written  English  sentence  involves,  in  general,  more  than 
simply  the  string  of  words.  Punctuation,  type  face,  and  the  like 
also  contribute  to  the  formation  of  the  complete  sentence  and,  there¬ 
fore,  must  be  considered  by  the  text-processing  system.  Secondly,  the 
TREET  programming  system,  as  can  be  seen  in  TREET-360  Newsletters  #2 
and  #13,  imposes  constraints  upon  input.  For  instance,  numbers  are  a 
separate  data  type  and  must  be  processed  differently  from  words,  wnich 
are  regular  TREET  symbols.  Characters  which  are  used  as  punctuation 
have  diverse  roles  in  TREET  syntax.  In  view  of  these  considerations, 
general  treatment  of  all  possible  elements  of  a  sentence  is  a  complex 
problem.  Fortunately,  some  punctuation,  notably  the  comma,  is  converted 
into  TREET  symbols  and,  therefore,  can  be  treated  in  ways  similar  to 
words.  For  instance,  the  comma  can  be  a  lexical  entry,  analogous  to 
the  word  and,  and  then  accounted  for  in  the  phrase-structure  rules. 
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Thus  far,  work  with  the  SAFARI  system  has  not  emphasized  solutions 
to  the  difficulties  just  outlined.  Most  punctuation  (except  the  comma 
and  the  question  mark)  is  not  encountered  in  the  subsets  of  English 
with  which  we  have  experimented.  In  the  case  of  numbers,  a  temporary, 
ad  hoc  solution  has  been  adopted.  The  examination  of  each  element  of 
the  sentence  begins  with  a  check  for  a  number,  and  if  one  is  found,  it 
is  assigned  the  lexical  category  NUM.  In  addition,  the  user  may  specify 
a  range  of  numbers  which  he  is  likely  to  use  as  names  of  years;  for  these 
a  categorization  as  a  noun  with  appropriate  features  is  made.  Non¬ 
numbers  are  assumed  to  be  TREET  symbols. 

The  processing  of  TREET  symbols,  or  "words"  as  we  shall  now  refer 
to  the  remaining  sentence  elements,  is  the  usual  case  in  the  Stage  I 
analysis.  Its  treatment  involves  the  use  of  MORPH,  a  morphological 
analysis  routine  whose  description  is  given  in  the  next  section  of  this 
report.  What  has  to  be  done  with  each  word  is  to  assign  it  its  possible 
lexical  categorizations,  which  may  be  thought  of  loosely  as  part-of- 
speech  labels  together  with  further  information  represented  as  features. 
If  every  word  or,  more  precisely,  every  form  of  every  word  were  in  the 
lexicon  supplied  to  the  program,  this  task  would  be  straightforward. 
However,  this  would  require  a  very  large  lexicon.  Thus  a  procedure  to 
analyze  the  prefixes  and  suffixes  on  a  word,  which  change  the  lexical 
categorizations  of  the  stems  in  fixed  ways,  is  very  desirable. 

In  general,  when  using  a  morphological  analyzer,  each  word  must  be 
sent  to  the  analyzer,  even  if  it  can  be  found  immediately  in  the 
lexicon  of  stems.  This  is  a  waste  of  effort  for  any  word  with  no  affix 
structure,  but  consider  an  input  such  as  does .  It  must  appear  in  the 
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lexicon  as  a  form  of  the  irregular  verb  to  do ,  but  the  word  does  might 
also  be  the  plural  of  doe .  In  practice,  however,  such  conflicts  are 
not  numerous,  and  at  the  cost  of  burdening  the  linguist  with  the  task 
of  writing  the  lexicon  to  cover  such  conflicts,  the  call  to  MORPH  for 
words  appearing  in  the  lexicon  has  been  omitted,  thus  speeding  the  pro¬ 
gram.  In'  the  case  above,  does  would  be  entered  into  the  lexicon  as 
both  the  verb  form  and  the  plural  noun,  though  stem-plus-suffix  forms 
normally  would  not  appear  explicitly  in  the  lexicon. 

As  will  be  seen  in  the  next  section,  the  last  step  in  the  morph¬ 
ological  analysis  procedure  is  the  application  of  redundancy  rules, 
which  supply  certain  default  feature  conditions.  These  rules  are  also 
applied  to  words  which  are  not  sent  to  MORPH,  thus  enabling  the 
entries  in  the  lexicon  to  be  somewhat  simplified. 

No  lexicon  is  complete,  and  a  word  may  be  found  which  is  not  in 
the  lexicon,  and  which  cannot  be  analyzed  by  MORPH  as  a  derivative  form 
of  a  stem  in  the  lexicon.  In  an  on-line  system,  such  as  SAFARI  is 
intended  to  be,  this  event  would  be  covered  by  provisions  for  the 
appropriate  man-machine  communication.  When  running  off-line,  one 
must  either  see  that  the  situation  does  not  arise,  or  provide  simple 
default  categorizations. 

The  lexical  entry  for  a  word  or  stem  is  a  list  of  its  possible 
categorizations.  Stage  I  of  SAFARI  associates  such  a  list  with  each 
element  of  the  input  sentence  (excluding  terminal  punctuation) .  Each 
categorization  is  a  list  whose  first  member  is  a  category  label,  and 
each  subsequent  member,  if  any,  is  a  feature-value  pair,  itself  a 
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two-element  list  specifying  the  label  and  value  of  a  feature.  Stage  I 
passes  this  categorization  information  on  to  the  rest  of  the  analysis 
sections  of  SAFARI  in  two  parts.  The  category  label  information  is 
passed  to  Stage  II,  the  parser,  which  is  not  set  up  to  consider  any 
feature  information.  The  latter  is  stored  for  examination  by  Stage  III, 
the  transformational  analyzer. 
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III .  Stage  I:  B.  MORPH- -The  Morphological  Analysis  Procedure 

MORPH  is  a  set  of  routines  which  partitions  words,  considered  as 
strings  of  characters,  into  their  stem-affix  structure,  and  assigns 
lexical  categorizations  on  the  basis  of  this  analysis,  thus  eliminating 
the  need  for  including  all  derivative  forms  of  words  in  the  lexicon. 

The  procedure  is  governed  by  three  sets  of  rules  provided  by  the  lin¬ 
guist  and,  like  all  of  the  SAFARI  analysis  programs,  is  independent  of 
the  current  set  of  rules  and  of  such  factors  as  which  affixes  are  being 
distinguished.  MORPH  is  also  independent  of  the  content  of  the  lexicon, 
which  it  consults  for  entries  for  stems. 

Briefly,  the  procedure  consists  of  the  following  steps.  Ana lysis 
rules  are  used  to  determine  possible  stem-affix  structures  correspond¬ 
ing  to  an  input  word.  Each  of  these  must  pass  the  criteria  of  having 
the  supposed  stem  appear  in  the  lexicon  and  of  having  the  supposed  com¬ 
bination  of  stem  and  affixes  allowed  by  a  set  of  morpheme -combinatorial 
rules.  Accepted  analyses  are  processed  using  redundancy  rules ,  which 
serve  to  specify  certain  default  conditions  for  the  final  categorizations. 

The  first  part  of  this  procedure,  the  use  of  the  analysis  rules,  is 
perhaps  the  most  difficult.  Certainly  it  requires  the  most  computing 
effort,  and  the  task  of  writing  the  analysis  rules  is  complicated  by 
many  subtle  linguistic  considerations,  such  as  spelling  variations. 

These  rules  must  Recognize  and  detach  all  affixes  under  consideration 
and,  in  addition,  they  must  restore  the  correct  spelling  of  the  presumable 
stem  after  such  detachments,  so  that  the  stem  can  be  found  when  searching 
the  lexicon.  In  practice,  rules  cannot  be  written  to  do  this  perfectly, 
but  must  be  optimized  to  yield  analyses  in  a  maximum  number  of  cases 
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where  analyses  should  be  made,  and  to  yield  a  minimum  number  of  spurious 
analyses.  Thus  rule  sets  take  on  a  heuristic  character,  in  order  to 
approach  this  goal,  particularly  if  a  restricted  vocabulary  is  being 
used.  Of  course,  the  complexity  of  the  analysis  rules  depends  on  the 
particular  affixes  which  are  to  be  detected. 

It  should  be  noted  that  an  input  word  may  have  more  than  one  poss¬ 
ible  analysis  into  a  stem  and  affixes.  Consider,  for  example,  the  word 
batters .  Proper  analysis  rules  will  reduce  this  to  bat+(ER)  +  (S)  . 

Bat  will  be  found  in  the  lexicon,  listed  as  a  noun  and  a  verb.  The 
attachment  of  (ER)  is  only  permissible  for  the  categorization  as  verb, 
and  the  morpheme-combinatorial  rules  will  yield  a  reading  of  noun, 
resulting  from  this  derivation.  The  final  categorization  will  be  a 
plural  nominalization ;  i.e.,  the  noun  batters ,  those  who  bat .  However, 
an  equally  valid  analysis  yields  the  stem  batter ,  as  in  cake  batters . 

In  order  to  cover  situations  such  as  the  above,  MORPH  must  retain  what 
appears  to  be  "intermediate"  results  during  the  decomposition  process. 
Otherwise  costly  retracing  or  backtracking  of  the  process  would  some¬ 
times  be  necessitated. 

The  operation  of  the  analysis  rules  can  be  indicated  in  detail  by  a 
description  of  the  syntax  of  a  rule.  Each  rule  is  actually  a  statement 
in  a  variant  of  the  string-processing  language  METEOR  (Bobrow,  1964), 
and  the  set  of  rules  comprises  a  METEOR  program.  METEOR  has  been 
made  available  for  use  in  MORPH  by  imbedding  within  TREET  a  version  of 
the  METEOR  language  from  which  capabilities  not  needed  for  the  task  at 
hand  have  been  omitted,  and  in  which  some  new  features  which  prove  use¬ 
ful  have  been  included.  Thus  while  the  reader  may  profit  by  referring 
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to  the  detailed  description  of  the  METEOR  syntax  in  Bobrow  (1964)  ,  dif¬ 
ferences  will  be  apparent  in  the  discussion  of  the  analysis  rule  format, 
which  follows. 

An  analysis  rule  consists  of  seven  fields,  only  two  of  which  are 
obligatory.  The  first  field  is  an  optional  name  for  the  rule,  by 
which  it  can  be  referenced  in  another  rule.  The  second  is  an  optional 
occurrence  of  the  symbol  $SAVE  (this  symbol  cannot  be  used  as  a  name) 
which,  if  present,  causes  the  program  to  save  the  partial  results  of 
the  analysis  prior  to  the  application  of  the  flagged  rule.  Saving  does 
not  occur  if  the  rule  does  not  apply.  The  third  field  is  an  optional 
occurrence  of  another  special  symbol,  $REV ,  which,  if  present,  specifies 
reversal  of  the  elements  to  be  analyzed,  before  application  of  the  rule. 
This  results  in  a  right-to-left  analysis.  The  fourth  and  fifth  fields 
are  lists  used  for  the  actual  specification  of  the  rule.  These  are 
required,  and  will  be  described  shortly.  The  sixth  field  is  an  optional 
name  of  some  other  rule  (i.e.,  a  symbol  in  the  first  field  of  another 
rule)  which  will  be  tried  next  if  the  present  rule  applies.  If  the 
symbol  END  is  in  this  field,  no  more  analysis  rules  will  be  tried  if 
the  present  rule  successfully  applies.  The  seventh  field,  also  optional 
cannot  be  present  unless  the  sixth  field  is  included.  It  specifies  a 
rule  to  be  branched  to  if  the  present  rule  fails.  END  may  be  used  m 
this  field  also.  In  the  absence  of  direction  from  these  last  two  fields 

control  passes  to  the  next  rule  in  sequence,  if  any. 

The  rule  specification  fields  describe  a  "before”  and  "after"  sit¬ 
uation,  respectively.  Thus  the  second  specifies  operations  to  be 
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performed  if  the  first  field  finds  a  match.  Elements  of  these  fields 
are  called  constituents ,  and  the  two  fields  are  called  the  left-half 
and  right-half  of  the  rule.  These  fields  are  processed  from  left  to 
right. 

Possible  left-half  constituents  include: 

a)  an  element  (a  letter  or  a  list  not  specifically  described 

below)  This  must  match  identically,  as  a  single  constituent. 

b)  a  list  of  elements,  headed  by  the  symbol  $0R  --  One  element 
must  match. 

c)  a  list  of  elements,  headed  by  the  symbol  $NOT  --  Any  element 
not  in  the  list  will  match. 

d)  a  symbol  of  the  form  $n,  where  n  is  a  digit  --  Any  consecutive 
n  elements  will  match.  This  is  used  to  require  at  least  n  ele¬ 
ments  before  a  suffix,  for  instance.  n  may  be  0;  $0  constrains 
the  match  to  start  at  the  left  boundary  of  a  word. 

e)  the  symbol  $$  --  This  matches  the  right  terminal  boundary  of 
a  word.  ("Right",  and  "left"  in  the  above  discussion  of  $0,  is 
defined  after  the  effect  of  an  occurrence  of  $REV.  Due  to  the 
availability  of  the  $REV  option,  $$  is  seldom  needed.) 

f)  the  symbol  $  --  This  matches  any  number  of  arbitrary  elements. 

g)  a  digit  n  --  This  matches  whatever  the  nth  constituent  matched. 
Obviously  it  must  be  at  least  the  n+lst  constituent. 

h)  a  list  whose  first  member  is  $FN  --  This  is  a  provision  to 
allow  more  complex  restrictions  than  $0R  or  $NOT.  See  Bobrow 
[1964]  for  details. 
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Right-half  constituents  specify  the  new  appearance  of  matching 
structure.  They  include 

a)  letters  or  lists,  which  are  inserted  as  constituents. 

b)  digits  n,  which  specify  the  retention  (and  new  location) 

of  the  nth  left-half  constituents. 

The  reasoning  behind  the  use  of  $SAVE  deserves  further  discussion. 
This  is  the  feature  allowing  retention  of  "intermediate”  results  that 
was  mentioned  earlier.  Consider  first  a  case  where  all  the  affixes  are 
suffixes;  e.g.,  comfortably .  Clearly,  saving  information  immediately 
after  detachment  of  an  affix  is  useless;  e.g.,  comf or tab  is  not  a  poss¬ 
ible  stem.  Unfortunately,  it  is  not  possible  to  decide  when  a  stem  has 
been  restored  by  subsequent  analysis,  unless  another  affix  is  detached. 
This, however ,  is  sufficient  to  resolve  the  all-suffix  case  --  the  output 
of  the  analysis  procedure  is  then  the  partial  results  just  before  detach 
ments,  as  well  as  the  final  result.  For  instance,  for  the  above  ex¬ 
ample,  the  output  will  be  comfortably ,  saved  before  detachment  of  the 
_ py ^  comf  or  tabled-  (LY)  ,  saved  before  the  -ab le  is  detached,  and  the  final 
result,  comf or t+( ABLE) +(LY) .  Therefore  each  analysis  rule  which 
actually  detects  and  detaches  an  affix  should  include  the  $SAVE  option, 
causing  retention  of  partial  results  immediately  before  any  successful 

application  of  the  rule. 

If  prefixes  are  also  present,  the  situation  is  more  complicated. 
Since  the  considerations  of  correct  analysis  require  particular  order¬ 
ings  of  the  rules,  in  general,  intermingling  prefix  and  suffix  detach¬ 
ments,  the  stem  restoration  following  a  suffix  detachment  may  not  be 
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comp  lete  at  the  time  of  a  prefix  detachment.  Fortunately,  spelling 
alterations  after  prefix  detachments  are  rarely  necessary,  so  a  possible 
solution  is  to  save  results  only  before  detaching  suffixes,  and  checking 
at  that  time  to  see  if  any  prefixes  have  been  detached  since  the  last 
save.  If  so,  the  result  could  be  saved  with  and  without  the  prefix 
detached;  this  assumes  that  the  prefix  can  be  reattached  with  no  spelling 
alterations.  For  example,  if  for  unc omf or t ably  the  order  of  detachment 
is  -ly ,  un- ,  and  -able ,  at  the  same  time  that  (UN)+comf or tabled- (LY) 
is  saved  prior  to  detachment  of  the  -able ,  the  form  uncomf or tab  led- (LY) 
could  easily  be  recreated  and  saved.  This  last  feature  has  not  been 
implemented  and  tested,  so  that  MORPH  presently  would  work  incorrectly 
if  a  prefix  were  detached  when  the  right-hand  portion  of  the  stem  was 
not  in  its  proper  form. 

Because  of  the  incorporation  of  the  $SAVE  option  into  analysis  rules, 
the  result  of  applying  the  set  of  analysis  rules  to  an  input  word  is,  in 
general,  a  list  of  possible  decompositions  of  the  input  into  a  stem  and 
associated  affixes  (including  the  "decomposition"  with  no  affixes) .  Each 
of  these  tentative  analyses  is  now  checked  and  processed.  First,  each 
stem  is  looked  up  in  the  lexicon.  Many,  of  course,  will  not  be  found, 
inasmuch  as  the  multiple  analyses  which  necessitate  the  $SAVE  option 
occur  infrequently.  Analyses  with  stems  which  are  not  located  in  the 
lexicon  are  discarded;  if  all  analyses  are  discarded,  the  input  word  is 
unanalyzable  as  far  as  MORPH  is  concerned,  and  the  program  is  unable  to 
provide  any  categorizations  for  it. 

For  each  supposed  analysis  whose  stem  is  found  in  the  lexicon,  a 
pass  through  a  set  of  mcrpheme-combinatorial  (MC)  rules  is  made  to 
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determine  information  about  the  input  word  on  the  basis  of  the  lexical 
categorizations  of  the  stem  and  the  affix  structure  of  the  decomposition. 
This  portion  of  the  procedure  actually  performs  two  functions.  It 
detects  and  discards  spurious  analyses  where  the  categorization  of  the 
stem  prohibits  attachment  of  the  observed  affixes.  Also,  for  acceptable 
analyses,  it  derives  partial  categorizations  for  the  input  word  (which 
will,  of  course,  differ  from  the  categorizations  of  the  stem)  --  a  task 
which  is  completed  by  the  use  of  the  redundancy  rules.  Before  describing 
the  algorithm  used  to  apply  the  MC  rules,  it  will  be  helpful  to  discuss 
the  syntax  of  a  single  such  rule. 

A  morpheme-combinatorial  rule  begins  with  a  categorization,  which 
presently  is  restricted  to  a  category  label  and  zero  or  one  feature- 
value  pairs.  The  second  and  third  fields  are  lists  of  prefixes  and 
suffixes,  respectively.  One  of  these  fields  must  be  NIL;  i.e.,  a  rule 
cannot  refer  to  both  prefixes  and  suffixes.  These  three  fields  specify 
the  stem  categorization  and  affix  structure  to  which  the  rule  applies. 

The  non-NIL  affix  list  has  the  following  form:  The  list  begins  with 
the  affix  nearest  the  stem  (note  that  this  is  the  reverse  order  for 
multiple  prefixes).  Each  affix  is  represented  by  a  list  (e.g.  "(D)" 
for  -ed)  ,  and  each  list  may  have  an  optional  second  member  of  or 

".".  The  specifies  a  match  with  a  flagged  (i.e.,  previously  matched) 

affix  only;  the  "."  specifies  a  match  with  an  unflagged  affix  only. 
Omission  of  this  second  member  allows  the  indicated  affix  to  match  in 
either  event.  The.  remaining  elements  of  the  MC  rule  form  the  fourth 
field,  a  list  of  categorizations  to  be  assigned  to  a  successfully  matched 


stem-affix  combination. 
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Each  rule  is  associated  and  stored  with  the  category  label  to  which 
it  applies.  More  than  one  rule  may  apply  to  a  given  label,  so  the  gen¬ 
eral  case  is  an  ordered  list  of  rules  pertaining  to  a  category  label. 

As  will  be  clarified  below  during  discussion  of  a  sample  set  of  MC 
rules,  use  of  the  flagging  feature  may  impose  a  requirement  for  a  par¬ 
ticular  ordering  of  the  lexical  categorizations  entered  into  the  lexicon 
for  a  stem. 

During  the  course  of  applying  the  MC  rules,  intermediate  categoriza¬ 
tions  of  the  stem  in  combination  with  some  of  its  affixes  are  obtained. 
Each  of  these  partial  results  is  marked  with  the  number  of  affixes  thus 
far  accounted  for.  Each  successful  application  of  an  MC  rule  produces 
intermediate  categorizations  accounting  for  exactly  one  more  affix. 

For  each  tentative  decomposition  of  the  input  word  produced  by  the 
analysis  rules,  the  process  of  applying  MC  rules  is  basically  a  cycle 
through  intermediate  categorizations.  This  is  done,  of  course,  for  all 
decompositions . 

Given  a  decomposition  whose  stem  appears  in  the  lexicon,  the  initial 
steps  are  to  count  the  number  of  affixes  in  it  (call  this  N)  and  to  set 
the  intermediate  categorizations  to  be  the  lexical  categorizations  of  the 
stem,  each  with  an  indication  that  no  affixes  have  been  accounted  for. 
Once  this  is  done,  MORPH  begins  considering  the  intermediate  categoriza¬ 
tions.  When  they  are  exhausted,  this  phase  of  the  process  is  complete. 

For  each  intermediate  categorization,  a  check  is  made  first  to  see 
if  the  number  of  affixes  accounted  for  is  equal  to  N.  If  this  is  so, 
the  categorization  becomes  input  to  the  next  set  of  rules,  the  redun¬ 
dancy  rules.  For  example,  in  the  case  of  the  trivial  decomposition  where 
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N=0,  the  lexical  categorizations  of  the  simple  stem  are  the  end  result 
of  the  (vacuous)  application  of  the  MC  rules . 

If  affixes  remain  to  be  accounted  for,  the  MC  rules  applying  to 
the  category  label  of  this  particular  intermediate  categorization  are 
obtained.  Each  such  rule  is  checked,  in  order,  to  see  if  a  match  can 
be  found.  The  feature-value  pair,  if  present  in  the  rule,  must  be  found 
among  the  feature-value  pairs  of  the  intermediate  categorization.  If 
this  requirement  is  met,  attention  turns  to  the  affixes.  The  prefixes 
or  suffixes  specified  by  the  rule  must  match  an  unbroken  string  in  the 
decomposition,  starting  at  the  position  adjacent  to  the  stem.  Flagging 
restrictions  in  the  rule  must  be  met  by  the  match.  Further  affixes  may 
be  present  in  the  decomposition  ;  all  such  would  be  farther  from  the  stem 

than  all  affixes  participating  in  a  match. 

If  no  MC  rule  for  the  category  label  produces  a  successful  match,  the 
intermediate  categorization  is  discarded;  i.e.,  the  proposed  analysis 
path  contains  an  illegal  stem-affix  combination.  If  a  successful  match 
is  made,  the  last  affix  of  the  decomposition  which  participated  in  the 
match  is  flagged,  if  it  had  not  been  flagged  previously  by  successful 
application  of  an  MC  rule  to  another  intermediate  categorization.  Note 
that  flagging  remains  in  effect  while  all  intermediate  categorizations 
of  a  given  decomposition  are  processed.  Thus  flagging  alone  cannot 
serve  to  keep  track  of  how  many  affixes  have  been  accounted  for  in  a 
given  intermediate  categorization. 

Successful  application  of  an  MC  rule  yields,  from  the  rule  s  last 
field,  new  intermediate  categorizations,  each  of  which  is  marked  as 
]^£ivlng  accounted  for  one  more  affix  than  the  old  intermediate 
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categorization .  If  a  new  categorization  has  the  same  category  label  as 
the  old,  feature-value  pairs  of  the  two  are  merged.  The  new  intermediate 
categorizations  are  added  to  the  top  of  the  list  of  those  to  be  considered. 

At  the  end  of  the  application  of  the  MC  rules,  zero  or  more  of  the 
decompositions  of  the  input  word  produced  by  the  analysis  rules  will 
have  one  or  more  categorizations  assigned  to  them.  MORPH  retains  the 
information  as  to  which  stem  underlies  each  such  categorization.  Any  in¬ 
formation  necessary  to  be  retained  from  the  particular  affix  structure 
is  assumed  to  be  entered  as  feature-value  pairs  by  the  MC  rules.  If  no 
categorizations  appear  at  this  stage,  it  is  as  if  the  stem(s)  were  not 
found  in  the  lexicon  --  MORPH  cannot  analyze  the  input  word.  Categoriza¬ 
tions  produced  by  the  use  of  the  MC  rules  are  now  sent  through  the 
redundancy  rules,  whose  application  will  now  be  described. 

The  role  of  the  redundancy  (RD)  rules  is  to  complete  the  categoriza¬ 
tion  of  a  word,  thus  giving  as  output  the  maximum  amount  of  syntactic 
information  available  for  that  word,  as  derived  from  the  lexicon  and 
possible  morphological  analysis.  The  particular  information  supplied 
by  the  RD  rules  is  in  the  form  of  default  feature-value  pairs.  Each  RD 
rule  begins  with  a  categorization  indicating  when  it  is  to  be  applied. 

As  is  the  case  for  MC  rules,  this  categorization  is  restricted  to  no  more 
than  one  feature-value  pair,  and  the  rules  are  stored  by  the  category 
label  to  which  they  apply.  The  remainder  of  the  rule  forms  a  list  of 
feature-value  pairs.  When  a  rule  is  found  to  be  applicable  to  a  cate¬ 
gorization,  these  pairs  are  considered,  and  if  none  of  their  feature 
labels  are  present  in  the  categorization  of  the  word  (i.e.,  no  conflicts 
are  found) ,  the  pairs  aia  added  to  the  categorization.  Because  of  this 
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"all-or-no thing"  algorithm  for  using  RD  rules,  it  is  expected  that  the 
simplest  type  of  rule  would  be  the  most  commonly  used,  namely  a  single 
feature-value  pair  to  be  added  to  applicable  categorizations. 

The  result  of  applying  the  RD  rules  is  the  set  of  final  categor¬ 
izations  for  an  input  word.  Note  that  RD  rules  cannot  increase  or 
decrease  the  number  of  categorizations  as  derived  by  the  MC  rules,  and 
that  there  is  no  requirement  that  any  RD  rules  apply  to  a  categoriza¬ 
tion. 

We  now  give  examples  of  analysis  rules,  MC  rules,  and  RD  rules, 
with  comments  on  each  set.  An  example  of  the  processing  of  an  input 
word  by  MORPH  using  these  sets  of  rules  is  then  given. 

Analysis  rules: 

1)  ($SAVE  $REV  ($0  S  ($NOT  A  I  S  U»  (1  (S)  3)  INGS) 

2)  ($SAVE  $REV  ($0  D  E)  (1  (D))  EINSB) 

3)  ($SAVE  $REV  ($0  G  N  I)  (1  (ING))  EINSB  END) 

4)  (INGS  $SAVE  $REV  ($0  (S)  G  N  I)  (12  (ING))  EINSDF) 

5)  ($REV  ($0  (S)  E  ($0R  10))  (1  2  4)  Y  END) 

6)  (EINSB  $REV  ($0  ($0R  (D) (ING) ) ($0R  L  R) ($0R  D  T  Z) )  (1  2  E  3  4)  END) 

7)  ($REV  ($0  ($0R  (D) (ING)) ($0R  C  U  V  Z) )  (1  2  E  3)  END) 

8)  (EINSDF  $REV  (($0R  (D) (ING)) ($0R  N  T) ($0R  A  I) ($N0T  A))  (1  E  2  3  4)  END) 

9)  ($REV  ( ($0R  (D) (ING) ) ($0R  L  R)  U  ($N0T  AO))  (1  E  2  3  4)  END) 

10)  (Y  $REV  ($0  ($0R  (S) (D) )  I)  (1  2  Y)  END) 

11)  ($REV  ( ($0R  (D) (ING)) ($0R  L  M  N)  2)  (1  2)  END) 

Rule  1)  detaches  the  suffix  -s_,  reducing  nouns  to  the  singular  form 
and  (third-person)  verbs  to  the  present  plural  or  infinitive  form.  The 
restriction  on  the  letter  preceding  the  s_  eliminates  many  incorrect 
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analyses,  such  as  for  analysis ,  grass ,  etc.  At  the  same  time  some 
correct  analyses  are  prevented,  e.g.,  taxis . 

Rules  2)  through  4)  detach  the  suffixes  -ed  and  -ing ,  rule  4)  cover¬ 
ing  the  -ing  +  -s_  case.  These  are  the  only  affixes  which  this  set  of 
analysis  rules  processes;  since  all  are  suffixes,  the  rules  all  make  use 
of  $REV,  specifying  right-to-left  processing.  Rules  5)  through  11) 
attempt  to  restore  stems  to  their  correct  form.  For  instance,  rule  9) 
restores  the  e  on  the  stem  of  such  inputs  as  manuf ac tur ing ,  ruled,  etc. 

The  restriction  prevents  incorrectly  adding  the  e  to  the  stem  of  such 
words  as  hauling ,  pouring ,  etc.  Only  two  known  incorrect  analyses  are 
made,  for  auguring  and  murmuring .  Rule  10)  replaces  _i  with  y_,  and  rule 
11)  removes  the  second  of  doubled  consonants,  as  in  programming . 

MC  rules: 

1)  ((V)  NIL  ((ING  .))  (ADJ  (ING  PLUS))  (N  (CMNF  CMN)  (ANIM  MINUS)(ING  PLUS))  ) 

2)  ((V)  NIL  ((S  .))  (V  (TNS  PRES) (NUM  SG))  ) 

3)  ((V  (TRANS  MINUS))  NIL  ((D  .))  (V  (TNS  PST))  ) 

4)  ((V)  NIL  ((D  .))  (V  (TNS  PST))  (ADJ)  ) 

5)  ((N)  NIL  ((S))  (N  (NUM  PL))  ) 

6)  ((N)  NIL  ((ING  *) (S  .))  (N  (NUM  PL))  ) 

For  this  set  of  rules,  the  legal  combinations  are:  a)  from  rule  1), 
verb  -f  -ing,  yielding  an  adjective  or  noun  with  appropriate  feature-value 
pairs;  b)  verb  +  -js,  with  the  information  obtained  from  the  suffix 
retained  by  encoding  it  in  feature-value  pairs;  c)  verb  +  -ed,  except 
that  for  intransitive  verbs  the  participle  (adjective)  form  is  not 
allowed,  so  two  rules  are  needed;  d)  noun  +  -js,  as  expected,  where  rule 
6)  covers  the  -ings  case,  which  involves  a  path  through  rule  1) 1 s 
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categorization  of  verb  •+■  -ing  as  a  noun.  The  use  of  the  " denoting  a 
match  with  only  an  unflagged  affix  in  the  first  four  rules  assumes  that 
the  lexical  categorizations  of  a  word  have  been  ordered  in  the  lexicon 
so  that  any  one  with  the  category  label  V  is  first.  Since  an  entry  in 
the  lexicon  might  have  categories  V  and/or  N,  rule  5)  must  allow  a 
match  with  either  a  flagged  or  an  unflagged  affix. 

RD  rules : 

1)  ((V)  (TNS  PRES) (NUM  PL)) 

2)  ((N)  (NUM  SG)) 

3)  ( (N  (HUM  PLUS))  (ANIM  PLUS)) 

4)  ((N  (ANIM  MINUS))  (HUM  MINUS)) 

These  rules  specify  default  information  as  follows:  If  a  categoriza¬ 
tion  as  a  (third-person)  verb  has  neither  tense  nor  number,  the  verb  is 
taken  as  present  plural;  nouns  not  marked  plural  are  assumed  singular; 
appropriate  "deductions"  are  made  regarding  the  features  of  humanity  and 
animacy  for  nouns . 

Consider  the  input  word  holdings .  MORPH  first  applies  the  analysis 
rules  to  the  string  of  its  letters,  (HOLDINGS).  Rule  1)  produces 
(HOLDING  (S))  ,  and  because  it  applies,  the  $SAVE  causes  retention 
of  the  tentative  analysis  (HOLDINGS).  Control  is  passed  to  rule  4),  INGS , 
which  applies,  detaching  the  second  suffix  to  produce  (HOLD  (ING)  (S)), 
and  saving  (HOLDING  (S))  as  a  possible  analysis.  Control  passes  to 
EINSDF,  rule  8) ,  and  subsequently  to  rules  9) ,  10) ,  and  11) ,  none  of 
which  apply  (correctly,  since  HOLD  is  a  correctly  spelled  stem),  and 
the  third  tentative  decomposition  is  therefore  (HOLD  (ING)  (S)). 
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Neither  holdings  nor  holding  should  be  in  the  lexicon,  not  being 
stems,  so  the  only  tentative  decomposition  of  interest  is  (HOLD  (ING)  (S)). 

A  possible  lexical  entry  for  hold  is  (HOLD  (V  (TRANS  PLUS))  (N  (CMNF  CMN))  ), 
which  indicates  that  hold  is  a  transitive  verb  or  a  common  noun.  (Note 
the  ordering  of  the  categorizations,  with  the  V  before  the  N.)  Given 
these  lexical  categorizations,  the  application  of  the  MC  rules  begins 
with  the  intermediate  categorizations  (0  V  (TRANS  PLUS))  and  (0  N  (CMNF 
CMN)).  The  zeros  indicate  that  no  affixes  have  been  accounted  for. 

For  the  tentative  analysis,  N  is  2  because  of  the  two  suffixes.  The 
first  intermediate  categorization  is  examined.  Its  category  label  is  V, 
and  the  four  MC  rules  pertaining  to  this  label  are  considered.  The  first 
of  these,  rule  1),  matches,  since  (ING)  is  unflagged.  This  causes  flag¬ 
ging  of  the  (ING)  so  that  the  tentative  decomposition  now  appears  as 
(HOLD  (ING  *)  (S)  ).  The  two  categorizations  of  the  MC  rule's  last  field 
become  intermediate  categorizations  with  l's  associated  with  them  to 
indicate  that  they  have  accounted  for  one  affix.  Thus  the  list  of  inter¬ 
mediate  categorizations  is  now  (1  ADJ  (ING  PLUS)),  (1  N  (CMNF  CMN) (ANIM 
MINUS) (ING  PLUS))  and  (0  N  (CMNF  CMN)).  Considering  the  first  of  these, 

1  is  not  equal  to  N,  and  there  are  no  MC  rules  applying  to  the  label 
ADJ,  so  this  path  is  discarded.  (Roughly,  this  says  that  the  adjective 
or  participle  form  holding  does  not  take  an  - s)  .  The  next  intermediate 
categorization  has  category  label  N,  and  there  are  two  MC  rules  for  this 
label.  The  first,  rule  5),  does  not  apply  because  the  (S)  is  not  adjacent 
to  the  stem  in  the  decomposition.  However,  the  next  applies,  resulting 
in  the  change  of  the  decomposition  to  (HOLD  (ING  *)  (S  *))  and  the 
following  list  of  intermediate  categorizations:  (2  N  (NUM  PL) (CMNF  CMN) 
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(ANIM  MINUS) (ING  PLUS))  and  (0  N  (CMNF  CMN) )  .  Since  N  is  2,  the  first 
of  these  is  saved  for  the  redundancy  rules. 

The  remaining  intermediate  categorization  triggers  an  attempt  to 
apply  rules  5)  and  6)  again.  5)  does  not  match,  as  before,  and  now  6) 
does  not  either,  due  to  the  flag  on  the  (S  *) .  Therefore,  this  categor¬ 
ization  is  discarded,  as  it  should  be  since  nouns  do  not  take  the  suffix 
-ing .  Note  that  this  part  of  the  process  would  not  have  worked  correctly 
without  the  flagging  operation. 

The  RD  rules  associated  with  N,  namely  2) ,  3) ,  and  4) ,  are  now  ap¬ 
plied  to  the  categorization  (N  (NUM  PL) (CMNF  CMN) (ANIM  MINUS) (ING  PLUS)). 
Rule  2)  has  no  effect  since  number  has  already  been  specified.  Rule  3) 
does  not  apply  since  the  feature-value  pair  restriction  is  not  met,  but 
rule  4)  applies,  yielding  as  final  output  from  MORPH  the  categorization 
(N  (HUM  MINUS) (NUM  PL) (CMNF  CMN) (ANIM  MINUS) (ING  PLUS)) .  MORPH  also 
reports  that  the  stem  associated  with  this  analysis  of  ho ldings  is  hold. 
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IV .  Stage  II:  The  Parser 

Once  each  word  of  the  input  sentence  has  been  assigned  its  lexical 
categorizations,  an  analysis  of  the  entire  sentence  is  made  with  respect 
to  a  grammar,  in  order  to  discover  the  structure  of  the  sentence.  The 
next  two  stages  of  SAFARI  are  devoted  to  this  process,  reflecting  the 
division  of  the  grammar  into  a  phrase-structure  component  and  a  trans¬ 
formational  component.  Stage  II  begins  this  process  by  performing  a 
context-free  parsing  using  a  set  of  phrase-structure  (PS)  rules.  The 
result  is  a  set  of  trees,  each  of  which  is  a  possible  surface  structure 
for  the  input  sentence. 

The  PS  rules  form  a  context-free  grammar,  and  the  word  "grammar" 
will  be  used  in  this  narrower  sense  for  the  remainder  of  this  section. 

In  SAFARI,  two  separate  grammars  may  be  specified,  one  for  statements 
and  one  for  interrogative  sentences,  since  the  query  flag  is  available 
to  determine  the  applicable  set. 

The  remainder  of  this  report  deals  heavily  with  trees;  therefore 
we  introduce  some  tree  terminology.  As  a  vehicle  for  illustration, 
consider  the  following  tree  representation  which  a  grammar  might  produce 
for  the  sentence  MITRE  produces  linguistic  systems. 


NP 


VP 


MITRE 


N 


PREMOD 


N 


MOD 


SYSTEMS 


ADJ 


LINGUISTIC 


i 
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This  is  a  tree  with  a  single  root  (note  that  roots  are  at  the  top 
of  a  diagram  of  a  tree) ,  but  we  define  a  tree  to  be  in  general  a  pos¬ 
sibly  multiply-rooted  structure.  This  allows  a  recursive  definition  of 
a  tree  as  follows: 

A  tree  is  an  ordered  list  of  roots  (nodes) .  Each  root  is 
either  terminal  (a  simple  node)  or  dominates  a  tree. 

In  the  diagram  above,  the  tree  is  a  list  of  one  root,  which  dominates 
a  tree  with  two  roots,  with  values  NPP  and  VPP .  Each  of  these  dominates 
a  singly-rooted  tree,  one  of  which  (VP)  dominates  a  doubly-rooted  tree, 
name ly 


Y 

PRODUCES 


LINGUISTIC 


Each  node  in  a  tree  is  a  root  of  some  subtree  of  that  tree,  and 
each  node  has  a  value  (e.g.,  S,  MITRE).  Multiple  roots  are  sisters 
of  each  other,  and  since  the  list  of  roots  is  ordered,  we  can  speak 
of  left  sisters  or  right  sisters  of  a  node.  The  roots  of  a  tree 
dominated  by  a  node  are  called  daughters  of  the  node,  and  again,  it 
makes  sense  to  speak  of  first  daughters,  right  daughters ,  etc.  The 
node  dominating  the  roots  of  a  subtree  is  called  the  parent  of  those 
roots;  thus  the  roots  are  daughters  of  the  parent.  In  addition,  each 
node  may  have  associated  features ,  as  well  as  a  value. 
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Each  categorization  for  a  word  in  the  input  sentence,  as  supplied 
bY  Stage  I,  can  be  considered  to  be  a  simple  tree  of  the  form 

LABEL 

WORD 

Strings  consisting  of  one  such  tree  for  each  word  in  the  sentence  are 
called  pre-trees ,  since  the  goal  of  a  successful  parsing  is  a  tree  re¬ 
presentation  of  the  sentence  with  the  elements  of  the  pre-tree  appearing 
as  what  might  be  called  terminal  subtrees.  Inasmuch  as  each  word  may 
have  multiple  categorizations,  the  number  of  pre-trees  may  be  quite 
large,  being  the  product  of  the  numbers  of  the  categorizations  for  the 
words  in  the  sentence.  Due  to  this  large  number  of  inputs  to  the  parser, 
and  due  also  to  the  fact  that  resulting  surface  trees  usually  share  many 
common  subtrees,  it  is  important  that  the  parsing  algorithm  be  efficient. 
This  criterion  is  met  by  the  parser  used  by  SAFARI.  It  is  a  modification 
of  one  proposed  by  Martin  Kay  (1964) ,  and  a  version  nearly  identical  to 
the  one  about  to  be  described  was  reported  in  Walker,  et  al.  (1966). 

The  procedure  is  a  bottom- to-top  algorithm  (cf.  Griffiths  and 
Petrick,  1965) ;  it  finds  all  the  trees  which  dominate  any  substring  of 
a  pre-tree.  Any  tree  immediately  dominated  by  more  than  one  node  will 
be  found  only  once,  and  each  of  the  nodes  which  dominate  it  will  point 
to  it.  The  algorithm  operates  simultaneously  on  all  the  pre-trees  pro¬ 
vided  by  the  lexical  look-up  step.  However,  by  way  of  illustration  a 
parsing  based  on  only  the  "correct"  pre-tree  will  be  considered  first. 
Such  a  pre-tree  for  the  sentence  The  organization  ships  computers  and 
control  systems  is 


DET 


N 


V 


N 


AND 


NA 


N 


THE  ORGANIZATION  SHIPS  COMPUTERS  AND  CONTROL  SYSTEMS 
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It  is  convenient  to  describe  the  parsing  algorithm  in  terms  of 
bins;  initially  each  of  the  elements  of  the  pre-tree  forms  a  separate 
bin  (e.g.,  there  are  seven  bins  for  the  example  above).  In  general, 
an  item  in  a  bin  is  either  a  terminal  node  (e.g.,  SHIPS  in  bin  3)  or  a 
non-terminal  node  with  daughters  (e.g.,  N  in  bin  4).  If  a  node  is  non¬ 
terminal  its  left-most  daughter  (also  an  item)  is  in  the  same  bin. 

Thus  the  leftmost  terminal  node  of  a  tree  dominated  by  a  non-terminal 
node  is  in  the  same  bin  as  the  non-terminal  node.  The  bin  coming 
immediately  after  the  bin  containing  the  rightmost  terminal  node  of  a 
tree  is  the  next  bin  for  that  tree.  If  a  node  has  more  than  one 
daughter,  then  the  n+lst  daughter  must  be  in  the  next  bin  for  the  tree 
dominated  by  the  nth  daughter.  For  instance,  consider  the  following 
subtree  of  a  parsing  for  the  example  pre-tree: 


The  first  daughter  of  S  is  NPP .  The  rightmost  terminal  node  of  the  tree 
dominated  by  NPP  is  ORGANIZATION  in  bin  2.  Therefore  the  next  bin  for 
that  tree  is  bin  3,  and  the  second  daughter  of  S,  VPP,  must  be  in  bin  3. 

A  complete  path  exists  between  two  nodes  A  and  B  if  either  B  is  in 
A's  next  bin  or  if  there  exists  a  node  C  such  that  a  complete  path  exists 
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be tween  A  and  C  and  B  is  in  C's  next  bin.  Each  node  on  a  complete  path 
is  called  a  path  node.  There  may  be  several  complete  paths  between  two 

t 

nodes,  and  these  paths  may  share  path  nodes. 

The  parsing  algorithm  is  as  follows: 

1*  Set  the  bin  index  i^  to  the  number  of  the  last  bin. 

2.  Call  the  first  node  in  bin  A,. 

i  1 

3.  For  each  rule  in  the  grammar  of  the  form 

A  -*  Ax  A2  .  .  .  Ak 

find  all  complete  paths  between  A..  and  A,  which  have  A, ,  A0 ,  .... 

I  k  12 

Ar  as  path  nodes;  i.e.,  the  A ^ ' s  are  values  of  the  path  nodes.  (In 
the  case  where  k  =  1  there  is  only  one  such  path.)  For  each  such 
path  add  to  bin.  a  node  with  value  A  which  is  the  root  of  a  tree 

l 

having  the  path  nodes  as  daughters.  (Since  trees  are  represented 
by  list  structure,  this  involves  merely  associating  daughter  pointers 
with  the  node  A.) 

4.  If  there  still  remains  in  bin.  a  node  which  has  not  been  pro- 

i  r 

cessed  by  Step  3,  then  call  this  node  A^  and  go  to  Step  3. 

5.  If  i  =  1,  the  algorithm  is  terminated.  Otherwise,  decrease 
by  1  and  go  to  Step  2. 

This  algorithm  will  find  all  trees,  according  to  the  grammar,  that  term¬ 
inate  in  substrings  of  a  pre-tree.  Therefore,  if  a  sentence  has  a  par¬ 
sing,  there  should  appear  in  bin  1  the  sentence  node  symbol  (S  in  the 
grammar  to  be  given  below)  corresponding  to  the  top  node  of  a  tree  whose 
rightmost  terminal  node  is  the  last  element  of  the  associated  pre-tree. 

A  sample  grammar,  of  no  particular  linguistic  interest  but  suf¬ 
ficient  to  parse  the  sample  sentence,  is  given  below.  The  format 
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illustrates  the  presentation  of  phrase-structure  rules  to  Stage  II  of 
SAFARI . 

(S  (  (NPP  VPP)  )) 

(NPP  (  (NP)  (NP  AND  NP)  )) 

(NP  (  (N)  (PREMOD  N)  (PREMOD  N  POSTMOD)  (N  POSTMOD)  )) 

(PREMOD  (  (DET)  (MOD)  (DET  MOD)  )) 

(MOD  (  (ADJ)  (NA)  (ADJ  NA)  )) 

(POSTMOD  (  (PP)  )) 

(PP  (  (PREP  NPP)  )) 

(VPP  (  (VP)  (VP  AND  VP)  )) 

(VP  (  (V)  (V  NPP)  (V  PP)  (V  NPP  PP)  )) 

It  is  more  convenient,  as  can  be  seen  from  the  description  of  the  par¬ 
sing  algorithm,  to  have  the  rules  expanded  and  rearranged  so  that  rules 
giving  rise  to  trees  with  the  same  first  daughters  are  grouped  together . 
This  is  done  by  the  program,  and  the  result  can  be  represented  schemat¬ 
ically  as  follows: 


MOD  -  ADJ 

POSTMOD  -  PP 

MOD  -  ADJ  NA 

PREMOD  -  DET 

NP  -*  PREMOD  N 

PREMOD  -»  DET  MOD 

NP  -  PREMOD  N  POSTMOD 

PREMOD  -  MOD 

PP  -»  PREP  NPP 

NP  -  N 

VP  -  V 

NP  ->  N  POSTMOD 

VP  -  V  NPP 

VP  -  V  PP 

MOD  _  NA 

VP  -  V  NPP  PP 

NPP  w  NP 

VPP  -  VP 

NPP  -  NP  AND  NP 

VPP  -  VP  AND  VP 

S  _»  NPP  VPP 
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Figure  IV-A  shows  the  result  of  applying  the  parsing  algorithm  to 
the  sample  pre-tree,  using  the  above  grammar.  Note  the  three  S  nodes 
in  bin  1;  they  dominate  different  trees  because  the  rule  S  -*  NPP  VPP 
allows  for  three  different  complete  paths,  one  for  each  of  the  VPP's 
in  bin  3.  The  tree  dominated  by  the  lowest  S  node  is  the  tree  used 
previously  to  illustrate  the  concept  of  next  bin;  it  has  bin  4  for  its 
next  bin,  and  since  it  does  not  dominate  the  entire  pre-tree,  it  is  not 
a  surface  tree.  Similarly,  the  tree  dominated  by  the  second  S  is  not  a 
surface  tree;  its  next  bin  is  bin  5.  However,  the  tree  dominated  by 
the  highest  S  node  is  a  surface  tree;  all  elements  of  the  pre-tree 
appear  as  subtrees  of  this  tree,  which  is  shown  separately  below. 
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Having  illustrated  the  operation  of  the  parser  upon  a  single 
pre-tree,  we  now  show  the  results  of  applying  the  parsing  algorithm  to 
a  complete  set  of  pre-trees.  Such  a  set  is  given  below  for  the  sentence 
IBM  ships  computers  and  control  systems  in  the  USA. 
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Figure  IV-A:  Result  of  applying  the  parsing  algorithm  to  the  "correct"  pre-tree 
for  the  sentence  The  organization  ships  computers  and  control  systems. 
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Due  to  the  two  words  with  multiple  categorizations,  there  are  six 
pre-trees  in  this  example.  The  parsing  algorithm  processes  them  all 
simultaneously,  since  the  multiple  categorizations  of  a  word  are 
simply  multiple  items  in  the  bin  whose  terminal  node  is  the  word. 

The  complete  set  of  bins  produced  by  parsing  the  above  set  of 
pre-trees  is  shown  in  Figure  IV-B.  Each  bin  contains  the  roots  of  all 
trees  generated  by  the  PS  rules  which  terminate  in  a  substring  of  the 
pre-trees  whose  leftmost  element  is  in  that  bin.  Among  these  are  ten 
nodes  with  value  S  in  bin  1,  four  of  which  are  surface  trees,  showing 
that  the  sentence  is  ambiguous  with  respect  to  the  sample  set  of  PS 
rules.  Obviously  not  every  pre-tree  need  result  in  a  surface  tree;  in 
this  example  only  two  of  the  pre-trees  account  for  the  surface  trees 
(two  from  each  pre-tree) . 

The  four  surface  trees,  shown  below,  share  much  common  structure. 
The  parser  is  able  to  operate  without  duplicating  any  of  these  common 
subtrees,  even  when  unravelling  the  structure  of  Figure  IV-B  into  the 
four  trees  which  represent  the  output  of  Stage  II.  Copies  will  have  to 
be  made  in  Stage  III,  however,  before  applying  the  transformational 
component  of  the  grammar  to  each  surface  tree. 
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Figure  IV-B:  Result  of  applying  the  parsing  algorithm  to  the  set  of  pre-trees 
for  the  sentence  IBM  ships  computers  and  control  systems  in  the  USA. 
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V •  Stage  III;  The  Transformational  Component 

As  we  have  just  seen,  at  the  termination  of  the  second  stage  of 
SAFARI,  the  input  sentence  has  been  converted  to  a  list  of  trees.  This 
list,  produced  by  a  context-free  parser,  contains  possible  surface 
structures  for  the  sentence.  Unless  the  list  has  but  one  member,  the 
input  sentence  is  ambiguous  with  respect  to  the  phrase-structure  com¬ 
ponent  of  the  grammar,  since  the  parser  makes  use  of  no  information 
other  than  the  phrase-structure  rules.  However,  further  information, 
in  the  form  of  feature-value  pairs,  is  available  from  Stage  I.  Before 
beginning  the  third  and  final  phase  of  analysis,  the  application  of 
transformations,  the  terminal  nodes  of  the  trees  produced  by  the 
parser  are  augmented  with  the  feature  information.  Consequently, 
while  applying  transformations  to  the  trees  in  order  to  obtain  base 
structures,  anomalies  may  be  detected  by  examining  features,  and  trees 
containing  the  anomalies  can  be  rejected,  thereby  refining  the  syn¬ 
tactic  analysis  by  reducing  the  amount  of  apparent  ambiguity.  The 
remaining  trees,  transformed  into  base  structures,  represent  the 
"underlying  content"  of  the  various  readings  of  the  original  sentence 
which  are  acceptable  to  the  particular  grammar  being  used.  Further 
transformations  are  used  to  put  base  structures  into  similar  "shapes", 
thus  producing  canonical  content  representations.  Provision  is  made 
for  the  linguist  to  specify  two  separate  sets  of  transformations,  one 
for  declarative  sentences,  and  one  for  questions.  SAFARI  uses  the  query 
flag  to  determine  the  appropriate  set. 

A  transformation,  from  the  programmer's  standpoint,  is  a  statement 
in  a  tree-manipulating  language.  At  present,  the  SAFARI  routines 
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which  make  up  the  transformational  analyzer  have  not  been  refined  so 
that  they  constitute  a  complete  computer  language  package.  Still,  the 
analogy  with  the  language  METEOR  for  string  manipulation  is  instructive. 
A  series  of  transformations  can  be  thought  of  as  a  program,  just  as 
the  set  of  analysis  rules  for  MORPH  forms  a  METEOR  program.  However, 
no  branching  is  permitted;  the  flow  is  a  linear  one  through  the  set  of 
transformations,  with  only  a  "skip  this  one"  feature  implemented.  As 
in  METEOR,  execution  is  interpretive,  though,  unlike  METEOR  statements, 
transformations  undergo  a  significant  amount  of  processing  when  they 
are  defined.,  to  convert  the  input  syntax  into  a  form  which  is  easier  to 
interpret.  The  analogy  holds  within  separate  statements  as  well. 
Transformations  and  analysis  rules  both  begin  with  a  name  and  specifi¬ 
cations  which  indicate  certain  variations  in  the  method  by  which  the 
transformation  or  rule  will  be  applied.  Following  these  fields  is  a 
pattern  representation  which  describes  the  structure  to  which  the  trans¬ 
formation  or  rule  is  applicable.  The  next  field  (or  fields)  indicates 
the  actions  to  be  performed  upon  any  structure  which  successfully 
matches  the  pattern. 

The  transformational  analysis  programs  have  been  written  to  be 
independent  of  the  particular  list  representation  used  for  a  tree. 

This  is  accomplished  by  writing  the  analyzer  using  functions  such  as 
SIS,  DAT,  PAR,  FEAT,  etc.,  through  which  all  references  to  a  tree  are 
made  in  terms  of  the  tree's  sisters,  daughters,  parent,  features,  etc. 
Since  TAP  is  a  macro-assembler,  macros  with  the  same  purpose  can  be 
coded  to  remove  the  extra  level  of  function  linkage  that  this  procedure 
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would  otherwise  introduce  in  compiled  programs  (i.e.,  by  simply  adding 
these  macros,  SIS,  DAT,  etc.  can  effectively  be  made  "primitives”  on 
the  level  of  such  functions  as  MEMl  in  terms  of  which  they  otherwise 
would  be  coded) . 

The  particular  list  representation  currently  used  for  a  tree  is  a 
list  of  3n  elements,  where  n  is  the  number  of  roots  of  the  tree.  Each 
of  these  n  root  nodes  are  sisters;  the  three  elements  describing  each 
node  are,  respectively,  the  value  of  the  node,  the  features  of  the  node, 
and  the  tree  dominated  by  the  node  (the  list  of  the  node's  daughters). 

The  element  specifying  feature  information  is  itself  a  list,  with 
an  even  number  of  members.  These  members  are  grouped  as  feature-value 
pairs,  but  without  any  additional  list  formatting.  (This  is  in  contrast 
to  the  format  used  by  the  lexicon  and  MORPH,  where  each  feature-value 
pair  is  a  two-element  list.)  Feature  information,  not  being  needed  by 
the  parser,  is  passed  directly  from  MORPH  to  the  transformational 
analyzer,  and,  prior  to  the  application  of  any  transformations,  is  in¬ 
serted  into  the  tree  output  of  the  parser.  At  the  same  time,  backward 
or  parent  pointers  are  inserted  into  one  of  the  count  fields  of  each 
node,  to  aid  in  the  analysis  process. 

We  shall  not  discuss  further  the  programs  which  apply  transforma¬ 
tions.  Instead,  the  focus  of  attention  will  be  on  the  input  syntax;  a 
complete  description  of  it  will  indicate  the  capabilities  of  the  trans¬ 
formational  analyzer.  We  shall  describe  in  detail  the  format  in  which 
transformations  are  presented  to  the  system  (via  a  function  called 


DEFTRAN) ,  and  enumerate  the  possible  actions  (structural  changes)  which 
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have  been  included  in  the  system  and  which  may  be  specified  in  particular 
transformations.  The  system  is  designed  in  a  modular  way  so  that  exten¬ 
sions  are  quite  easy  to  include.  For  more  discussion  of  the  operation 
of  transformations,  see  Gross  (1967). 

There  are  five  types  of  fields  in  a  transformation.  Some  of  these 

may  be. present  any  number  of  times,  but  all  fields  of  the  same  type 

must  be  adjacent,  and  different  types  must  be  in  the  following  order: 

1)  name  --  one  only;  must  be  present 

2)  options  --  zero  or  more 

3)  structural  description  (SD)  --  one  only;  may  have  two  parts 

4)  restrictions  --  zero  or  more 

5)  structural  changes  --  zero  or  more 
Some  comments  on  these  fields  are  necessary: 

1)  The  name  of  a  transformation  may  be  any  legal  TREET  symbol. 

2)  All  symbols  after  the  name  and  before  the  first  list  are  taken 

to  be  options,  which  specify  how  the  system  is  to  use  the  transforma¬ 
tion.  Options  come  in  groups,  and  only  one  member  of  any  group  may  be 

specified  in  a  given  transformation.  For  each  group  there  is  a  default 
case,  which  is  the  action  taken  by  the  program  if  no  member  of  the 
group  is  present  in  a  transformation.  The  default  options  are  set  by 
the  user  before  entering  his  transformations. 

In  the  present  system  there  are  three  option  groups: 

a)  BND  or  NBND  --  These  options  concern  bounding.  If  a  trans¬ 
formation  is  bounded,  then  the  SD  search  will  not  go  below  any 

node  whose  value  is  S  and  which  does  not  match  a  symbol  in  the 


SD. 
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b)  RECURS  or  NRECURS  --  These  options  concern  recursive  appli¬ 
cation  of  a  transformation.  A  recursive  transformation  is 
applied  to  its  own  output  until  it  has  no  further  effect. 

c)  REJECT  or  NREJECT  --  The  option  REJECT  causes  termination 
of  consideration  of  any  tree  which  matches  the  structural 
description.  (Note:  In  the  present  off-line  system,  all 
transformations  are  necessarily  obligatory.) 

3)  The  SD  begins  with  the  first  list  among  the  arguments  of  the 
transformation.  If  this  list  is  followed  by  another  list,  then  that 
list  is  also  part  of  the  SD.  The  second  list  is  used  to  indicate  those 
elements  of  the  SD  which  themselves  have  SD's.  This  feature  will  be 
elaborated  upon  shortly,  under  f)  below. 

Let  us  use  the  symbol  SDl  to  refer  to  the  first  (and  possibly  only) 
list  of  the  SD.  This  list  can  be  described,  recursively,  as  a  list  of 
segments ,  where  the  possible  segments  are  as  follows: 

a)  an  X  --  This  corresponds  to  the  variable  X  used  by  lin¬ 
guists.  Note  that  all  variables  are  called  X  in  this  system. 

b)  the  symbol  ANY  --  This  segment  matches  any  single  node; 
thus  it  differs  from  a  variable,  which  can  match  any  amount 
of  tree. 

c)  a  symbol  other  than  X  or  ANY  --  This  specifies  that  a 
node  whose  value  is  this  symbol  must  match  this  segment. 

d)  a  list  headed  by  an  ,  whose  remaining  elements  are 
symbols  --  The  asterisk  is  an  OR  operator;  this  segment  must 
match  a  node  whose  value  is  one  of  the  symbols  on  the  list. 
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e)  a  list  headed  by  a  "$",  whose  remaining  elements  are 
symbols  --  The  dollar  sign  marks  an  optional  segment  and  the 
list  is  treated  as  a  disjunction;  i.e.,  this  segment  matches 
a  node  whose  value  is  one  of  the  symbols  on  the  list,  but  if 
no  such  node  is  found  the  segment  still  matches  successfully. 

f)  a  list  of  segments,  i.e.,  an  SDl  --  This,  of  course,  is 

the  recursive  part  of  the  definition  of  SDl.  In  this  case, 
each  embedded  SDl  must  be  labeled.  This  is  accomplished  in 
the  second  list  of  an  SD.  Each  label  is  of  one  of  three 
forms,  which  correspond  essentially  to  the  three  types  of 
segments  described  under  c) ,  d) ,  and  e)  above.  The  only 
difference  is  that  the  is  to  be  omitted  in  the  disjunc¬ 

tion;  otherwise  both  syntax  and  interpretation  are  the  same. 

Labels  are  given  in  the  order  that  the  left  parentheses  of 
the  corresponding  embedded  SDl's  appear.  Thus,  the  embed¬ 
ding  structure  is  not  visible  by  examination  of  the  label 
list  alone.  Each  label  is  a  value  or  list  of  possible  values 
for  a  node  (an  optional  node  if  "$"  heads  its  label)  which 
must  dominate  the  structure  specified  in  the  SDl,  though  the 
label  need  not  name  the  immediate  parent  of  the  structure. 

Any  segment  or  sub-segment  in  the  SDl  may  be  preceded  by  a  number 
(unsigned  integer) ,  which  may  be  used  in  a  restriction  or  structural 
change  to  refer  to  that  segment.  The  value  or  order  of  these  numbers 
is  arbitrary . 

4)  A  number  following  the  SD  signals  the  presence  of  a  restriction; 
each  restriction  is  specified  by  a  number,  a  name,  and  a  list  of  arguments. 
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The  number  is  one  attached  to  a  segment  in  the  SD1,  and  the  restriction 
specifies  conditions  which  must  be  met  by  nodes  in  order  that  they  match 
that  segment.  References  to  other  segments  (by  their  numbers)  may  be 
included  as  arguments  of  the  restriction.  Such  a  reference  must  refer 
to  a  segment  preceding  (to  the  left  of)  the  restricted  node  in  the  SD 
since,  operationally,  the  reference  is  made  to  the  node  matched  to  that 
segment.  Since  features  cannot  be  specified  in  the  SD,  incorporation 
of  features  results  in  an  increased  use  of  restrictions.  Existing  re¬ 
strictions  are: 

a)  EQA  --  This  restriction  has  one  argument,  n,  and  specifies 
that  the  node  to  which  the  restriction  applies  must  be  equal 
to  the  node  matching  the  segment  numbered  n.  Equality  means 
the  values  of  the  two  nodes  as  well  as  the  structure  they 
dominate  must  be  identical.  EQA  completely  ignores  features. 

b)  NOTREP  --  This  is  a  restriction  with  no  arguments  that  is 
used  for  preventing  loops  when  applying  transformations 
iteratively,  i.e.,  searching  the  tree  for  all  matches  of  the 
SD  and  then  applying  the  transformation  in  each  instance  of 

a  match.  In  fact,  this  restriction  must  be  attached  to  some 
segment  of  the  SD  in  order  for  the  transformational  analyzer 
to  operate  iteratively.  It  specifies  that  the  restricted 
segment  may  not  be  satisfied  by  the  same  node  of  the  tree 
in  more  than  one  match  of  the  SD. 

c)  FEATP  --  This  is  a  restriction  of  two  or  more  arguments 


which  is  used  to  check  or  match  the  features  of  a  node.  The 
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arguments  are  logically  divided  into  two-  or  three-element 
groups,  as  follows.  The  first  and  last  elements  specify  the 
label  and  value,  respectively,  of  a  feature-value  pair.  The 
optional  middle  element  is  the  logical  negation  sign  — i.  The 
label  must  be  given  explicitly;  the  value  may  be  given 
explicitly  or  as  a  number,  in  which  case  the  value  is  taken 
from  the  feature  list  of  the  node  to  which  that  number  refers. 

(If  absence  of  a  feature  is  given  an  "either"  interpretation, 
this  is  always  meaningful.)  Note  that  features  are  hereby 
prohibited  from  having  numerical  values.  The  effect  of  the 
restriction  FEATP  is  that  the  node  to  which  it  applies  must 
satisfy  the  indicated  constraint  on  its  features;  for  each 
group  given  as  an  argument  to  FEATP,  the  node  must  agree  in 
the  value  of  that  feature,  or  disagree  in  the  case  that  the 
— i  is  present . 

d)  IMDOM  --  This  restriction  of  one  argument,  n,  specifies 
that  the  node  to  which  it  is  attached  must  be  immediately 
dominated  by  the  node  n. 

In  addition,  the  need  for  multiple  restrictions  on  a  node,  boolean 
functions  of  restrictions,  conditional  restrictions,  and  more  compli¬ 
cated  restrictions  initiated  the  alteration  of  the  system  to  allow  use 
of  ordinary  TREET  functions  as  restrictions.  Such  "restrictions"  are 
given  their  arguments  in  Cambridge  Polish  format,  and  are  evaluated  to 
obtain  a  result  which  is  used  as  a  predicate;  the  restriction,  attached 
to  a  node  as  usual,  is  satisfied  if  and  only  if  its  value  is  non-NIL. 
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For  use  in  this  way,  a  function  FEATPP  has  been  provided,  which  operates 
much  as  FEATP ,  except  it  has  an  additional  argument  n,  which  must  appear 
first.  n  is  used  for  the  number  of  the  node  to  which  FEATPP,  used  as  a 
predicate,  applies.  Thus  a  restriction  may  depend  only  upon  the  features 
of  previous  nodes  in  the  tree.  In  a  similar  vein,  the  predicate  EXIST (n) 
checks  the  existence  of  a  node,  returning  the  node  as  its  value  if  it  is 
found . 

Admittedly,  this  capability  to  write  arbitrary  restrictions,  as  well 
as  a  similar  provision  for  augmenting  the  repertory  of  structural  changes 
which  will  be  described  shortly,  has  not  been  provided  in  a  way  that  is 
convenient  for  a  linguist  to  use,  particularly  if  he  has  had  no  program¬ 
ming  experience.  However,  it  was  felt  that  the  details  of  refining  the 
language  from  the  user's  point  of  view  should  be  postponed  until  the 
use  of  a  general,  powerful  system  indicated  the  proper  directions  and 
content  for  the  refined  system. 

5)  The  structural  changes  are  the  final  arguments  of  a  transforma¬ 
tion.  The  format  of  each  consists  of  a  name  followed  by  an  argument  list. 
Thus  they  are  distinguished  from  restrictions  by  the  absence  of  the 
preceding  number.  Arguments  to  a  structural  change  may  include  numbers 
referring  to  SD  segments;  in  some  cases,  noted  individually  below,  the 
segment  referred  to  may  not  be  a  variable.  If  a  numerical  argument  to 
a  structural  change  is  presented  with  a  leading  minus  sign,  the  refer¬ 
enced  node  will  be  erased.  The  structural  changes  are  applied  in  the 
order  in  which  they  appear  in  the  transformation.  Thus  one  change  may 
alter  a  node  referenced  by  a  later  change.  Each  change  is  a  separate 
TREET  function,  so  that  it  is  relatively  easy  to  alter  or  add  to  the 


repertory  of  changes . 
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In  the  descriptions  given  below  of  presently  defined  structural 
changes,  n  is  a  segment  number  while  a_  may  be  either  a  segment  number 
or  a  tree  specified  explicitly  as  follows:  if  a  is  a  symbol,  it  is 
taken  to  be  a  tree  with  a  single  node  whose  value  is  that  symbol; 
otherwise  a_  describes  a  singly-rooted  tree  using  a  list  representation 
somewhat  different  from  that  described  earlier  in  this  section.  The 
representation  of  a  tree  with  m  roots  is  a  list  of  the  m  node  values, 
with  the  list  representation  of  any  non-empty  daughter  tree  placed 
immediately  to  the  right  of  the  value  of  its  intended  parent.  In 
addition,  a  value  may  be  given  as  a  number,  in  which  case  the  node 
referenced  by  that  segment  of  the  SD  is  inserted  at  that  point  in  the 
tree,  together  with  all  the  structure  which  it  dominates.  Daughters 
may  not  be  specified  explicitly  for  nodes  referenced  via  a  segment 
number . 

a)  ALD(a  n)  --  add  a  as  leftmost  daughter  of  n 

b)  ALS(a  n)  --  add  a  as  immediate  left  sister  of  n 

c)  ARD(a  n)  --  add  a  as  rightmost  daughter  of  n 

d)  ARS(a  n)  --  add  a  as  immediate  right  sister  of  n 

e)  CADJL(a  n)  --  Chomsky  adjoin  a_  to  the  left  of  n 

f)  CADJR(a  n)  --  Chomsky  adjoin  a  to  the  right  of  n 
Chomsky  adjunction  involves  "doubling"  the  node  n,  i.e., 

inserting  a  node  with  the  same  value  between  n  and  its 

parent,  and  then  adding  a  as  the  appropriate  type  of 


daughter  to  the  inserted  node. 

g)  ERASE (n)  --  erase  the  node  n  (and  all  structure  it  domi¬ 
nates)  ,  where  n  may  not  be  a  variable 
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When  a  node  is  erased,  either  by  ERASE,  by  substitution 
of  NIL  (see  SB  below) ,  or  because  of  a  negatively  signed 
number  as  an  argument  to  some  other  structural  change,  what 
is  actually  erased  is  the  first  node  dominating  it  whose 
parent  branches;  i.e.,  the  highest  non-branching  dominating 
node  is  deleted.  Except  when  SB  has  been  used,  the  deletion 
is  followed  by  a  check  of  the  parent  of  the  erased  node  for 
pruneability  (see  PRUN  below  for  a  discussion  of  pruning) . 
h)  PRUN(n)  --  prune  node  n,  where  n  may  not  be  a  variable 
The  node  n  is  pruned  whether  or  not  it  is  pruneab le  in 
the  sense  to  be  defined  below.  Pruning  involves  removing  the 
node  from  the  tree  but  retaining  any  structure  it  dominates. 
The  daughters  of  the  pruned  node  become  daughters  of  the 
deleted  node's  parent.  For  example,  if  the  node  with  value 


After  pruning,  the  deleted  node's  parent  is  checked  for 
pruneability.  A  node  is  pruneab le  if  either  i)  it  has  as  its 
only  daughter  a  node  with  the  same  value  (i.e.,  a  structure 
of  the  form  -  A 

I 

A 

A 

which  could  arise,  for  example,  after  a  Chomsky  adjunction 
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and  an  erasure) ,  or  ii)  it  does  not  branch  (has  no  more  than 
one  daughter)  and  its  value  is  on  the  list  $MUSTBRANCH,  which 
is  a  global  TREET  variable  which  the  user  sets  before  use  of 
the  transformational  analyzer  to  specify  nodes  which  he  wishes 
to  have  pruned  when  they  do  not  branch.  Whenever  a  node  is 
checked  for  pruneability  (e.g.,  after  a  prune  or  an  erase) 
and  one  of  the  above  two  conditions  is  satisfied,  the  node  is 
pruned  (causing,  incidently,  another  pruneability  check), 
i)  SB(a  n)  --  substitute  a  for  n,  where  n  may  not  be  a 
variable 

The  tree  whose  root  is  the  node  given  by  a  replaces  the 
node  n  (and  all  structure  dominated  by  it) .  If  a  is  NIL,  and 
only  in  this  case,  the  highest  non-branching  node  dominating 
n  is  what  is  replaced;  i.e.,  deleted.  (It  may  be  desirable 
to  test  the  parent  of  n  for  pruneability  after  the  substitu¬ 
tion.) 

i)  ADFEAT(n  label,  value,  .  .  .  label  value  )  --  add  the 
J  11  mm 

feature-value  pairs  label,  value, ,  . . . ,  label  value  to 

- 1  - 1  - m  - m 

n,  where  n  may  not  be  a  variable 

The  feature  list  of  the  node  denoted  by  n  is  augmented  by 
the  indicated  feature-value  pairs,  value ^  may  be  specified 
by  a  segment  number,  directing  ADFEAT  to  obtain  the  value  from 
the  value  associated  with  that  label  on  the  feature  list  of 
the  indicated  node.  When  adding  a  feature-value  pair  to  n, 

ADFEAT  deletes  any  pre-existing  pair  with  the  same  label. 

Since  ADFEAT  processes  its  argument  list  sequentially  from  left  to 
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right,  this  means  that  a  single  use  of  ADFEAT  can  override  a 
feature-value  pair  more  than  once,  a  property  useful  in  deal¬ 
ing  with  optional  nodes. 

f)  The  TREET  functions  E  and  EVAL  may  also  be  used  as  "struc¬ 
tural  changes",  in  conjunction  with  the  function  EXIST(n) 
which  evaluates  to  the  node  n.  Since  the  arguments  of  E  and 
EVAL  are  any  TREET  or  Cambridge  Polish  expression,  respectively, 
this  allows  full  generality  for  specifying  structural  changes. 

Care  must  be  used,  since  all  arguments  within  the  expression 
are  evaluated. 

We  conclude  the  discussion  of  structural  changes  with  an  account  of 
an  experimental  one.  This  will  serve  to  give  the  flavor  of  the  kind 
of  work  for  which  the  transformational  analyzer  has  been  used.  It  also 
emphasizes  the  power  of  the  analyzer,  in  that  new  structural  changes  can 
be  tested  without  altering  existing  programs. 

The  use  of  features,  as  presently  conceived,  involves  the  assign¬ 
ment  of  feature-value  pairs  to  high-level  nodes  of  a  tree  on  the  basis 
of  tree  structure  and  lower-level  feature-value  pairs.  Initial  feature 
information  is  inserted  only  at  leaves  of  the  tree,  or  at  parents  of 
leaves . 

In  particular,  consider  the  portion  of  a  tree  which  reflects  word 
or  phrase  conjunction.  The  lower-level,  more  numerous  nodes  will  have 
feature  information,  and ■ transformations  are  used  to  set  the  approp¬ 
riate  feature  lists  of  the  higher-level  nodes.  There  are  two  ways  of 
looking  at  this  task.  One  is  to  consider  it  to  be  an  operation  on  the 
descendants,  and  to  use  an  iterative  transformation  to  cycle  through 
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the  low-level  nodes  and  perform  the  indicated  ADFEAT's  to  parent  nodes. 
The  other  approach  is  to  iterate  through  the  higher- level  nodes  (i.e., 
each  conjoined  phrase),  and  to  employ  a  structural  change  to  calculate 
the  desired  feature  list  on  the  basis  of  certain  features  of  daughters, 
etc  . 

The  former  method  is  readily  implemented  using  the  machinery  de¬ 
scribed  in  the  body  of  this  report.  It  has  the  additional  advantage  of 
using  very  simple  structural  changes .  However ,  this  writer  (a  program¬ 
mer  ,  not  a  linguist)  feels  that  a  strong  case  can  be  made  for  consider¬ 
ing  feature-raising  operations  as  properly  being  operations  on  the  con¬ 
joined  phrases,  that  is,  on  the  high-level  nodes.  At  the  expense  of 
more  complicated  structural  changes,  one  has  the  changes  applying  to 
fewer  separate  nodes,  and  the  interrelations  of  the  daughters  are  more 
clearly  kept  in  mind  using  this  viewpoint  or  direction  for  the  trans¬ 
formation.  This  is  in  contrast  to  treating  each  low-level  node  in¬ 
dependently  of  its  sisters. 

Without  any  clear  idea  of  what  a  general  transformation  to  "poll" 
daughters  should  be  capable  of  doing,  one  was  written  to  perform  in 
the  following  way:  POLLFEAT  has  a  variable  number  of  arguments.  The 
first  is  the  number  of  the  node  to  which  it  is  to  apply.  The  second 
is  a  node  name,  and  POLLFEAT  will  consider  descendants  with  this  name 
only.  The  third  argument  is  an  integer  specifying  which  level  below 
is  to  be  searched  for  these  descendants.  Only  1  and  2  are  recognized 
at  present.  Remaining  arguments  are  feature  labels,  and  POLLFEAT  will 
be  concerned  only  with  feature-value  pairs  having  these  labels.  The 
designated  pairs,  when  found  on  the  specified  nodes,  are  added  to  (or 
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override  an  existing  pair  with  that  label  on)  the  feature  list  of  the 
top-level  node  specified  by  POLLFEAT's  first  argument.  For  example, 
P0LLFEAT(1  N  2  ANIM  TIME)  would  raise,  to  the  node  specified  by  1, 
feature-value  pairs  with  the  labels  ANIM  and  TIME.  It  would  search 
all  daughters  of  daughters  of  1  whose  node  name  was  N  to  find  such 
feature-value  pairs.  Presumably  some  might  not  have  a  value  specified 
for  one  of  these  features,  so  that  cycling  through  is  necessary  in 
general  to  raise  a  maximum  amount  of  information.  If  a  value  is 
encountered  for  a  label  previously  found,  the  new  value  replaces  the 
old.  It  is  expected  that  POLLFEAT  would  ordinarily  be  used  after  a 

rejection  rule  had  discarded  undesirable  disagreements,  so  the  order  of 
polling  might  be  immaterial. 

Such  a  structural  change  has  been  tested,  and  performs  satisfac¬ 
torily,  though  its  task  may  seem  a  bit  strange.  In  comparison  with 
iterations  through  descendants,  POLLFEAT  appears  faster;  i.e.,  perform¬ 
ing  this  particular  more  complicated  structural  change  few  times  is 
more  economical  than  applying  a  simpler  one  more  often  to  achieve  the 
same  effect.  The  economy  is  due  most  likely  not  to  some  theoretical 
linguistic  efficiency,  but  to  the  idiosyncracies  of  the  present  imple¬ 
mentation  (in  terms  of  algorithm  and  coding)  of  the  transformational 
analyzer . 

The  following  is  an  example  of  a  transformation,  which  illustrates 
the  material  of  this  section. 


I 
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DEFTRAN ( 

WHREPL  (X  1  N  ($  PP)  (($  PREP)  3(2  NW)  X)  X) 

(REL  NPPW) 

1  FEATP  (CMNF  CMN) 

2  AND(  (NOTREP)  (FEATP  HUM  1)  ) 

ADFEAT(3  NUM  1  ANIM  1) 

SB (1  2) 

\  j -JL. 

1  /V 

This  transformation,  for  WH-replacement ,  replaces  WH-words  by  their 
antecedents  as  explained  below.  There  are  no  options  specified,  and 
we  assume  the  default  conditions  to  indicate  unbounded,  non-recursive 

application  not  as  a  rejection  rule. 

The  SD  specifies  a  match  with  a  node  named  N,  which  may  appear 
after  an  arbitrary  amount  of  tree.  The  N  must  be  followed  by  a  REL, 
though  the  two  nodes  may  be  separated  by  an  optional  PP .  The  REL  is 
specified  in  the  label  for  the  SDl  (($  PREP)  3(2  NW)  X).  The  REL  must 
begin  with  a  NPPW  (again  from  a  label) ,  which  must  appear  first  in 
the  REL  except  for  a  possible  PREP.  The  NPPW  must  dominate  an  NW. 

Any  amount  of  structure  may  then  follow.  The  restrictions  further 
require  that  the  N  must  have  the  feature-value  pair  (CMNF  CMN)  on  its 
feature  list.  The  second  restriction  is  a  complex  one  of  the  kind 
described  at  the  end  of  the  discussion  of  restrictions.  AND  is  an 
ordinary  TREET  function,  and  its  arguments  are  written  in  Cambridge 
Polish.  This  accounts  for  the  difference  between  the  syntax  of  the 
two  calls  to  FEATP.  The  entire  restriction  constrains  the  NW,  and 
the  presence  of  the  NOTREP  has  the  effect  of  making  the  transformation 
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iterative.  Thus  all  matches  of  the  structural  description  will  be  found 
which  have  dif  f  erent  NW 's  .  That  is,  we  iterate  through  all  NW's,  which 
are  intended  to  be  the  WH-words.  In  addition,  the  WH-word  must  agree  in 
the  feature  HUM  with  the  N,  its  intended  antecedent.  An  example  of 

structure  that  will  be  matched  is 

I 

I 


NW  [HUM  MINUS] 
WHICH 


This  illustrates  the  fact  that  immediate  dominance  is  not  required  in 
matching  an  SD,  unless  IMDOM  is  present  as  a  restriction. 

The  structural  changes  specify  that  for  each  match  of  this  iterated 
search,  the  features  NUM  and  ANIM  of  the  N  will  be  attached  to  the  NPPW 
(given  by  the  3) ,  and  the  antecedent  (N)  will  be  substituted  for  the 
NW.  No  erasing  is  done.  The  result  of  these  changes  in  the  tree  above 


would  be 


n: 


PRjMOD 
ART 


THE 


N  [ HUM  MINUS 
CMNF  CMN 
ANIM  PLUS 
NUM  SG] 


SHIP 


PREP 


ON 


NPPW  [ANIM  PLUS 
NUM  SG] 

N  [HUM  MINUS 
CMNF  CMN 
ANIM  PLUS 
NUM  SG] 


SHIP 
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Thus  the  ship  on  which  he  sailed  would  be  transformed  into  the  ship  on 
ship  he  sailed,  and  appropriate  bookkeeping  of  features  would  be  carried 
out  simultaneously. 
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VI .  Stage  IV:  Storage  and  Retrieval 

SAFARI,  despite  its  obvious  worth  as  a  grammar  tester,  is  a  complete 
information  retrieval  package,  at  least  for  small  bodies  of  data.  During 
the  development  of  preliminary  versions,  various  query  strategies  and 
forms  of  content  storage  were  tested.  At  first,  fixed  storage  formats 
were  used,  which  entailed  special-purpose  programs  for  putting  informa¬ 
tion  into  these  formats  and  for  searching  the  resulting  store.  The  cur¬ 
rent  version  is  more  flexible;  it  assumes  that  the  transformational 
apparatus  of  Stage  III  performs  the  formatting. 

This  way  of  organizing  the  system  has  a  number  of  implications. 

First  and  foremost,  different  storage  formats  may  be  tried  without  any 
reprogramming  of  the  system.  The  linguist  has  only  to  alter  the  set 
of  transformations.  Second,  the  running  time  of  the  system  is  increased. 
A  special-purpose  program  is  usually  faster  than  a  general  routine,  and 
certainly  the  use  of  the  powerful  transformational  analyzer  as  a  for¬ 
matting  device  requires  more  computing  effort  than  a  single  program  to 
perform,  in  effect,  a  fixed  transformation  or  two.  However,  the  time 
required  for  searching,  it  turns  out,  is  not  increased  significantly, 
since  searching  employs  a  simple  matching  technique,  as  we  shall  see 
later.  Third,  it  is  more  difficult  to  describe  the  operation  of  the 
storage  and  retrieval  phase.  All  that  can  be  done  is  describe  the 
operation  of  the  very  general  store  and  search  programs,  and  then 
indicate  the  few  simple  guidelines  and  requirements  which  the  writer 
of  the  transformational  grammar  is  requested  to  observe  when  he  designs 


a  particular  format. 
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Obviously,  since  the  transformational  analyzer  is  used  to  set  up 
the  format  of  information  to  be  stored,  all  items  which  are  stored  are 
trees.  Each  tree  is  "cataloged'1  under  various  words  (more  precisely, 
s terns  of  words)  appearing  in  it  as  terminal  nodes;  i.e.,  a  pointer  to 
the  tree  is  added  to  a  list  of  such  pointers  on  the  property  lists  of 
some  of  the  words  appearing  in  the  original  sentence.  The  user  specifies 
which  words  by  setting  the  variable  $CATNODS  to  a  list  of  category  labels; 
each  word  dominated  in  the  tree  by  one  of  these  labels  will  be  used  as  a 
catalog  key.  Thus  a  tree  might  be  pointed  to  by  all  its  nouns,  verbs, 
and  adjectives,  for  instance. 

Another  feature  of  the  cataloging  process  involves  subordinate 
clauses.  These  are  detected  and  cataloged  separately.  The  clause  will 
be  a  subtree  headed  by  a  node  with  some  distinguishable  node  name,  and 
therefore  can  be  isolated  easily.  Subordinate  clauses  are  supplied 
with  a  pointer  to  the  full  tree  resulting  from  the  original  input  sen¬ 
tence,  so  that  context  can  be  preserved.  Because  of  this  feature  the 
"keying"  process  described  above  is  boundeu  within  clauses,  i.e.,  a 
tree  might  be  cataloged  under  all  the  nouns  appearing  in  its  main  clause. 
The  intent  is  to  catalog  the  sentence  The  federal  government  issued  a 
bulletin  which  concerned  computers  under,  for  instance,  the  nouns 
government  and  bulletin ,  the  verb  i s sue ,  and  the  adjective  f edera 1 , 
and  at  the  same  time  to  catalog  the  subordinate  clause  (preserving  the 
fact  that  it  appeared  subordinately)  in  a  form  such  as  Bulletin  concerned 
computers  under  the  nouns  bulletin  and  computer  and  the  verb  concern. 

If  the  input  sentence  was  a  question,  as  determined  by  examination 
of  the  query  fla.g,  then  the  resulting  tree  is  not  stored,  but  matched 
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against  the  store  to  obtain  "answers."  The  first  step  in  this  process 
is  to  narrow  down  the  number  of  trees  with  which  the  query  tree  will  be 
compared.  At  present,  SAFARI  uses  a  very  simple  technique,  which 
obviously  could  be  modified.  The  query  tree  is  scanned  to  find  a 
"determinate"  terminal  node  dominated  by  a  member  of  the  list  $CATNODS. 
(E.g.,  which  is  not  a  determinate  adjective.)  Then  the  search  can  be 
restricted  to  trees  containing  the  word  on  this  terminal  node,  for  all 
such  trees  are  listed  on  the  property  list  of  this  word.  To  make  it 
theoretically  possible  to  ask  a  completely  indeterminate  question,  such 
as  Who  did  what? ,  a  default  option  is  provided,  in  which  case  the 
system  makes  use  of  a  list  comprised  of  pointers  to  all  trees  in  the 
store . 

The  query  tree  is  compared  with  each  of  the  relevant  trees  in 
sequence,  and  successful  matches  are  returned  as  answers.  As  mentioned 
in  the  Overview,  little  work  has  been  done  on  the  problem  of  finding  a 
good  output  format  for  answers.  We  do  insist  that  when  a  matching  tree 
was  originally  a  subordinate  clause,  the  tree  resulting  from  the  entire 
input  sentence  be  used  for  output,  to  preserve  context  and  avoid  poss¬ 
ible  misinterpretation. 

The  tree  matching  routine  used  in  the  search  operates  according  to 
the  following  algorithm.  Basically,  it  is  a  recursive  procedure,  re¬ 
quiring  each  node  of  the  query  to  match  the  corresponding  node  in  the 
intended  answer,  which  may  have  additional  nodes  as  well.  Trees  are 
matched  by  lef t- to-right  processing  of  their  list  representations. 

This  results  in  a  depth-first  search. 
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When  comparing  two  nodes  (i.e.,  the  general  case),  first  the  values 
of  the  nodes  are  considered.  The  two  values  match  successfully  if  one 
of  three  conditions  is  met:  i)  they  are  identical;  ii)  the  value  of 
the  node  in  the  query  is  Q;  iii)  the  values  are  both  members  of  one  of 
a  set  of  equivalence  classes  which  the  user  is  allowed  to  specify  by 
means  of  a  special  variable. 

Features  are  checked  only  if  the  value  of  the  node  in  the  query  is 
a  member  of  another  user-supplied  list.  If  checked,  each  feature-value 
pair  associated  with  the  node  in  the  query  must  be  present  on  the  feature 
list  of  the  intended  matching  node.  Order  of  the  pairs  is  irrelevant. 

If  the  match  is  successful  so  far,  the  daughters  are  checked.  This 
is  done  by  simple  recursion,  except  for  the  case  of  conjoined  phrases. 
These  are  identified  by  yet  another  user-supplied  list,  consisting  of 
the  values  of  nodes  intended  possibly  to  be  expanded  as  conjoined 
phrases.  These  nodes  are  assumed  to  have  an  odd  number  of  daughters, 
with  the  even-numbered  ones  being  conjunctions  (i.e.,  connectives) . 

When  a  node  heading  a  conjoined  phrase  is  encountered,  the  search 
checks  to  see  if  each  odd-numbered  daughter  of  the  query  node  matches 
some  odd-numbered  daughter  of  the  intended  matching  node,  i.e. ,  the 
order  of  the  phrases  is  immaterial. 

If  the  daughters  match,  then  the  sisters  are  checked  in  the 
straightforward  way.  When  checking  daughter  nodes  or  sister  nodes,  the 
match  succeeds  if  all  nodes,  if  any,  in  the  query  are  successfully 
matched.  This  allows  queries  to  match  trees  with  deeper  structure 
and/or  more  right  sisters.  Note  that  additional  sisters  in  intended 
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matches  must  be  r ight  sisters  to  nodes  matching  nodes  in  the  query. 

In  order  to  make  the  preceding  search  algorithm  useful,  the  format 
of  the  trees  produced  by  the  transformational  process  must  conform  to 
certain  guidelines.  In  particular,  each  tree  must  be  "filled-out"  so 
that  trees  have  the  "same1'  shape,  modulo  conjoined  phrases.  This  means 
that : 

a)  "Null"  versions  of  optional  nodes  must  be  inserted  when 
such  nodes  are  absent,  if  their  proper  position  is  to  the 
left  of  nodes  which  are  present.  For  instance,  if  an 
auxiliary  is  permitted  before  verbs,  the  slot  for  it  must 
always  be  filled  in. 

b)  Since  subordinate  clauses  are  cataloged  separately  as 
well  as  left  in  their  original  context,  it  follows  that  the 
transformational  grammar  must  insure  that  clauses,  considered 
separately,  have  the  same  shape  as  any  "top-level"  sentence. 

c)  Conjoined  phrases  must  be  altered  so  that  each  adjacent 
pair  of  conjoined  elements  is  separated  by  a  conjunction, 
such  as  and .  This  means  that  null  connectives  sometimes 
will  have  to  be  introduced. 

d)  In  the  case  of  questions,  it  is  incumbent  upon  the  lin¬ 
guist-user  to  provide  that  certain  terminal  nodes  are  replaced 
with  Q,  which  will  match  any  node  name;  i.e.,  Q  is  the  only 
node  value  which  the  search  procedure  recognizes  as  deter¬ 
minate.  This  must  be  done  for  the  indeterminate  "question 


words,"  such  as  what ,  where,  who ,  etc.  In  addition,  the 
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replacement  must  be  made  for  nodes  which  the  user  does  not 
want  to  take  narrowly;  e.g.,  articles  can  be  ignored  when 
searching  if  a,  an,  and  the  are  replaced  by  Q  in  a  query. 

Since  base  structures  have  a  single  fixed  ordering  for  those  components 
which  are  present,  performance  of  the  above  modifications  insures  the 
similarity  of  structure  necessary  for  the  retrieval  process. 

The  preceding  discussion  has  ignored  one  problem.  This  is  the  fact 
that  the  output  of  the  analysis  phases  of  SAFARI  may  be  ambiguous,  i.e., 
multiple  trees.  Then  the  question  arises  as  to  which  one  should  be 
cataloged  and  stored  or  used  as  a  query.  This  is  a  situation  which 
demands  on-line  man-machine  interaction.  Since  the  system  presently 
runs  off-line,  there  is  no  way  to  make  a  reasonable  choice,  so  some 
unsatisfactory  "criterion"  such  as  "first"  must  be  used.  However,  this 
is  not  a  fundamental  problem,  merely  an  inconvenience  to  be  endured 
until  on-line  operation  becomes  a  reality. 


-59- 


VII .  References  and  Selected  Bibliography 

Bobrow,  D.  G.  METEOR,  a  LISP  interpreter  for  string  transformations. 

In  E.  C.  Berkeley  and  D.  G.  Bobrow  (Eds.),  The  programming  language 
LISP .  Information  International,  Inc.,  Cambridge,  Mass.,  1964. 

Chapin,  P.  G. ,  Gross,  L.  N.  Norton,  L.  M.,  Beller,  R.  J.,  and  Browne, 

C.  T.  SAFARI,  an  on-line  text-processing  system:  user's  manual. 
MTP-60 ,  The  MITRE  Corp . ,  Bedford,  Mass.,  1967. 

Chapin,  P.  G. ,  and  Norton,  L.  M.  A  procedure  for  morphological  analysis. 
MTP-101,  The  MITRE  Corp.,  Bedford,  Mass.,  1968. 

Griffiths,  T.  V.,  and  Petrick,  S.  R.  On  the  relative  efficiencies  of 
context-free  grammar  recognizers.  Communications  of  the  ACM,  1965. 

8,  pp .  289-300. 

Gross,  L.  N.  On-line  programming  system:  user's  manual.  MTP-59,  The 
MITRE  Corp.,  Bedford,  Mass.,  1967. 

Kay,  M.  A  general  procedure  for  rewriting  strings.  Paper  presented  at 
the  Annual  Meeting  of  the  Association  for  Machine  Translation  and 
Computational  Linguistics,  Bloomington,  Indiana,  1964. 

Walker,  D.  E.,  Chapin,  P.  G.,  Geis,  M.  L. ,  and  Gross,  L.  N.  Recent 
developments  in  the  MITRE  syntactic  analysis  procedure.  MTP-11, 

The  MITRE  Corp.,  Bedford,  Mass.,  1966. 

Walker,  D.  E.  On-line  text  processing:  introduction  and  overview. 

MTP-57 ,  The  MITRE  Corp.,  Bedford,  Mass.,  1967. 

Walker,  D.  E.  SAFARI,  an  on-line  text-processing  system.  Proceedings 
of  the  American  Documentation  Institute,  1967,  4,  pp .  144-147. 

Zwicky,  A.  M.,  Friedman,  J.,  Hall,  B.  C.  and  Walker,  D.  E.  The  MITRE 
syntactic  analysis  procedure  for  transformational  grammars.  AFIPS 
Conference  Proceedings:  Fall  Joint  Computer  Conference,  1965,  27, 
pp .  317-326. 


■  ^  .  -M 

-  J -  i  •.  ■ ..  .  .  ;  *  ••  ■  ■  '•  "  . -i.  ■  .  .*--  . 

i  ~  -  i>  ■  ■  -  i  \  .  i  '  *< .  ...  ■  •  ■  ‘  .  ••  v.'-'  >  ,  .V<  '■p 

, 

V  J  -  -X  V  ,  -  '  ,  5i  XX-  ■'  :  ‘ 

. 

;  ■-  g 

'  .  ■  t  V  .  .  - —.  '  > 

,  ■  )  /.  f  'I  I  ■  ■ 

-  ,  -  "  ■  d>  ■  1  .  :  -  •  ,  X  .  -  •  -  S 

■  l  0  :  i  v  Xy.p-puxxA  -'X~  ’f§ 

.... 

X  ■  .  r  '  \  «  XXi  V  ;;:;y  X  ■  ■ '  :  ''-X  iM 

. 


' ■ .  i 


I  -  r  •;  ■ '  1  -  -  ■  '  ' 

i  ' .  ■.  ■  >h  1  ■  ,  x  ..-  ,  ;  ■  ■■ :y  -■  -1-  :  ■  .,  ■  x.  : .  ..  - 

,  '  '  .  .  .  .  ..  ■  .  *■> 

.  ;  ......  -  - 


■{  /'■/  '  •  .  ■!>-  .  .  V  J.;X  XS iO'  y  \  --t'1 

.  ■'  V\>‘  -  ri  n'  J'..-  .-'yt  ^  • 

-  ■  -  •  .  .  •  -  s  -  '  '  ■ 

'  •  "  '  i  '>  '  ■  ^  '  y  '  .V  .  -'•■  ■■'  /.  •'V  V  .  '  "  j  .  .  V-  t  > 

--  *  ■  ■  i-  ,  ■  ‘v,  r .  i.  V/f3 

-  -  •  ..  •  .  -tC  ^  I  -T  -X'..  -V  '  !\ 

--  .  J  '  .  ..  i  ■  '  '  , 

-  —  .  .  ■ 

.  .  ‘y-.  .  -  2  '  ■  ft  -  ■  T-.  >'  v 

=  v  -•  .  •  -  .-  -  ••..  • .?/ '•  .  ..w.ni. /.  k  l \  -  ‘  .y'V  >. 


•  y  .  ' 


■ . 


V-v-  .  -  ;  ^  -  -  -  -  '  .  ! 

\ ■  ■  vk’  ••  •  <. 

■  T.  -  X.',  ;  :  " 

V.  ..'-yv  y  k.Jk'l'-t  v',  ■". 


.  ■  '  .  ■  ,  '  t  "  ,  ■  ::  ■  '  ■ 

s  S|  ;  ;  '  $  .  ;  :  p 


:■  -  ■  V  \-s  'c 

“?  •  '  y  .  _  -  ‘  I  - *V  ■ 

.  X  '  ”  ;  1  }  ,  ' 


'  ,<;■■■  '  .'•>  ...  -X  '  '  ;'  '-V  X’ 

'  '-r,r  -  ;  ..  ••  ....  ■  ■'  ■;  Si 

'  \  s  £  ■■  i  "■  ;x  ■  ■  ’  ■  ■  VI  -  5 


-v  -?V  -  •;r-.-v-,x.  ;  ---x; 

'  If  ’  X  1  ■  fr  r: 


“T 


■  r 


■  >  :•  -  x;x'  -vm  ;,x‘  Xx-x- -x  ...  •  x.  x,; 

■  ■■■ '  X  v  if  /  :  '  X  ■  i  WU  :  - 

■  .  i  l  /  %  {  ■  '  ;  '  -  \ .  %  i  ■-  i  ■  . 

■  ... 

.....  '  .  ■  !  :  ■  ' 


X 

;  ■ 


a 


,  .  x  •  -■  >  i  r  .  .  ^ ' . 

■  ■  ■  ■  .  ■  .  -  ■  ■  , 

....  .  -  :  ■  ■  ■  ■'  ■■  :'X  ■  ■■  ■  .  -  :■  - 

•  ’  •  -  •  ,  .  •  .  •  .  *  -  .  ■  ^  «  •  v  -J  '  V  \  V?  41  :  ,  S.-  .  \\  *.  ■>>-•>■  L  ?■;  ■  i  -  ■  A  ..  /;-v\- 

1  '  -■  '  '  "  -  ’  .  r  ;\r  .  ..X,-:r  .v'',  -  -"rs'  '  '  '•  y  ^  AX 

..  -  i  "x  .  £  0  ■  ■  ;  '  ■;  r  V'-  ■ .  -?v  v  ‘  1  x  :1 ' 

i  ■  "  '  ■  ’  .  r-‘  -  -  ?  -■ 

‘  i.  I  !  -  ■  -  !■  .  ‘  I"  v 


-  X  v  •  - :  x  .  x  v  .  .  .v-xr  \\  *  -  * '  ->■  nv 
-  <  :  k  . 

-  .  •  -  j  -  •  •  x.  '-.x  -.  *• 

N  ,  -  ■  i  '  4'-  ■  -V-  x  -  X- 

J  .  -  -X  vv  -  X  ; 


,  -■  x-.L".  -  'V  'd  ••  ,  -  ■  ■  'M  x  >-  ■■ 

X  .  '  .  .  -  .  yt.  ^  '  - 

:  X  ■:  .  ' 

•  i  1  X  ...  •••  ’■  T-  .  *  -  ,  ’ri'-  S)  '  ,v' >-'■  ^  'f-f 

.  i  ....  -  ■  -  .  ..  <  .  ^  ..  i 

_  1  y1  •  ■  .  .  ■  -  •  .  '  \. ,  ^  •  t  V 

!  i  '  '  .  ■  X  ;  .  -■  ■  ' 

■  ■  ... 

a  '  -  ■  1  -  ;  .  .-v  y..  ,  i  :  ■  -  .  . 

.  ■  '  •  ■<  i!  !  .  %  :  ■  ■  '  . 

•  ■  •  .  _  ■ .  ■■  .  ’  ci  . '  k-.fr  ■  -  \  j  f .  v .  ■.  i 

.  ?  y  i>  .  ■  •-  -  :vT  %  '  .  ■  \ 

■  -  j  '  ■- 

> 

■  1 

"■  ■'  -  \  .y  •  -i  -  -X  '  f  X  •  :  -  -■  .  "X*  ■.  '  •  4  X  .  -V  i,  ’  ' .  d 

:  :  :  '  .  X  .  .  ...  ..  -  -  v-/...  .  ' 


